-- Logs begin at Thu 2022-07-14 11:24:19 UTC, end at Thu 2022-07-14 12:37:55 UTC. -- Jul 14 12:09:12.968503 dv-cinder-848900-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 12:09:12.978513 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 12:09:12 2022] *** Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: nodename: dv-cinder-848900-3-iscsi Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: machine: x86_64 Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: clock source: unix Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: pcre jit disabled Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: detected number of CPU cores: 4 Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: current working directory: / Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: detected binary path: /usr/bin/uwsgi-core Jul 14 12:09:12.980459 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: your processes number limit is 47680 Jul 14 12:09:12.981149 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: your memory page size is 4096 bytes Jul 14 12:09:12.981149 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: detected max file descriptor number: 2048 Jul 14 12:09:12.981149 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: lock engine: pthread robust mutexes Jul 14 12:09:12.981149 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: thunder lock: enabled Jul 14 12:09:12.981149 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 12:09:12.981149 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 12:09:13.025631 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: Python main interpreter initialized at 0x558e8c7cc9c0 Jul 14 12:09:13.025631 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: python threads support enabled Jul 14 12:09:13.025631 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: your server socket listen backlog is limited to 100 connections Jul 14 12:09:13.025631 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: your mercy for graceful operations on workers is 90 seconds Jul 14 12:09:13.026008 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 12:09:13.026099 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: *** Operational MODE: preforking *** Jul 14 12:09:13.026299 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: *** uWSGI is running in multiple interpreter mode *** Jul 14 12:09:13.026299 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: spawned uWSGI master process (pid: 103719) Jul 14 12:09:13.026502 dv-cinder-848900-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 12:09:13.027053 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: spawned uWSGI worker 1 (pid: 103720, cores: 1) Jul 14 12:09:13.027384 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: spawned uWSGI worker 2 (pid: 103721, cores: 1) Jul 14 12:09:13.027533 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 12:09:13.690600 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 12:09:13.691609 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 12:09:14.815379 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:09:14.815379 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: from cryptography.utils import int_from_bytes Jul 14 12:09:14.815929 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:09:14.815929 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: from cryptography.utils import int_from_bytes Jul 14 12:09:14.817889 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:09:14.817889 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: from cryptography.utils import int_from_bytes Jul 14 12:09:14.818355 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:09:14.818355 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: from cryptography.utils import int_from_bytes Jul 14 12:09:17.322786 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 12:09:17.323387 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 12:09:17.323512 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 12:09:17.323943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 12:09:17.324048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 12:09:17.324135 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 12:09:17.324230 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 12:09:17.324312 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 12:09:17.324537 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.324651 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 12:09:17.324859 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.324959 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 12:09:17.325179 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.325280 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.325502 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.325602 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.325828 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.325932 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.326137 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.326238 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.326456 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.326556 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.326796 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.326899 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.327122 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.327220 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.327382 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.327478 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.327698 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.327796 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.327999 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.328092 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-3-iscsi {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.328315 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.328402 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.328623 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.328708 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-3-iscsi {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.328933 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.329059 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.329241 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.329340 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.329541 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.329634 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.329856 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.329942 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.330157 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.330243 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.330529 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.330736 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.331210 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.331337 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.331505 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.331640 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.331818 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.331947 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.332121 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.332211 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.332430 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.332520 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.332766 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.332873 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.333081 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.333174 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.333388 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.333518 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.333707 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.333819 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.334012 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.334110 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.334333 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.334421 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-3-iscsi {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.334640 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.334728 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.335030 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.335124 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-3-iscsi {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.335342 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.335437 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.335657 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.335739 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.335969 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.336097 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.336342 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.336426 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.336661 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.336765 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.336969 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.337063 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.337282 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.337375 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.337603 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.337708 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.337910 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.337998 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.338225 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.338322 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.338544 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.338639 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.338863 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.338956 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.339172 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.339286 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.339480 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.339580 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.339786 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.339897 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.340088 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.340270 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.340390 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.340479 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.340640 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.340727 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.340946 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.341042 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.341218 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.341304 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.341527 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.341615 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.341849 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.341937 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.342112 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.342201 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.342364 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.342457 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.342683 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.342792 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.342973 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.343062 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.343293 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.343388 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.343610 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.343697 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.343915 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.344012 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.344218 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.344316 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.344521 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.344608 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.344824 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.344910 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.345126 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.345214 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.345429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.345515 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.345734 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.345820 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.346540 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.346712 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.346922 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.347095 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.347231 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.347434 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.347534 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.347763 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.347931 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.348075 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.348183 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.348398 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.348495 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.348797 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.348893 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.349051 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.349138 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.349380 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.349477 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.349702 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.349799 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.350021 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.350106 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.350328 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.350426 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.350631 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.350726 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.350960 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.351062 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.351270 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.351365 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.351575 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.351663 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.351886 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.351974 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.352133 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.352221 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.352432 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.352520 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.352735 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.352830 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.353048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.353143 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.353391 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.353530 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.353655 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.353816 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.353961 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.354061 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.354259 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.354356 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.354561 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.354662 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.354888 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.354979 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.355191 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.355277 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.355492 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.355597 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.355794 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.355880 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.356097 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.356184 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.356397 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.356491 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.356698 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.356785 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.356997 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.357095 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.357302 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.357391 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.357603 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.357689 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.357904 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.357992 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.358207 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.358301 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.358511 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.358608 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.358837 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.358943 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.359142 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.359230 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.359444 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.359558 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.359748 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.359863 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.360062 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.360151 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.360363 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.360449 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.360663 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.360767 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.360978 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.361066 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.361277 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.361363 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.361580 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.361666 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.362450 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.362553 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.362754 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.362880 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.363101 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.363191 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.363403 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.363493 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.363709 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.363861 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.364014 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.364109 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.364314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.364403 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.364615 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.364703 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.364917 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.365013 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.365218 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.365306 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.365519 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.365607 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.365819 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.365913 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.366115 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.366201 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.366413 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.366505 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.366717 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.366836 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.367039 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.367135 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.367355 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.367442 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.367657 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.367822 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.367965 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.368051 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.368270 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.368357 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.368572 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.368660 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.368887 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:09:17.368974 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.369218 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.369304 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.369550 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.369637 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.369877 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.369976 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.370191 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.370278 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.370501 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.370595 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.370837 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.370930 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.371163 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.371261 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.371473 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.371560 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.371781 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.371869 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.372092 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.372188 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.372399 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.372492 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.372708 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.372795 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.373017 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.373113 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.373331 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.373427 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.373644 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.373730 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.373959 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.374065 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.374269 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.374605 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.374605 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.374836 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.374916 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.374994 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.375205 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.375291 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.375519 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.375597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.375844 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.375930 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.376217 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.376324 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.376468 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.376548 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.376797 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.376875 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.377117 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.377195 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.377483 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.377569 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.377805 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.378123 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.378200 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.378430 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.378505 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.378737 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.378868 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.379167 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.379327 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.379425 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.379723 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.379808 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.380039 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.380217 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.380350 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.380534 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.380661 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.380854 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.380973 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.381287 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.381492 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.381623 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.381802 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.381927 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.382227 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.382304 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.382541 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.382646 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.382882 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.382994 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.383196 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.383284 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.383508 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.383596 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.383818 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.383915 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.384238 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.384363 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.384451 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.384645 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.384759 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.384964 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.385055 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.385280 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.385368 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.385596 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.385691 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.385905 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.385992 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.386212 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.386307 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.386522 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.386619 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.386858 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.386948 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.387167 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.387255 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.387474 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.387569 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.387787 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.387874 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.388093 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.388181 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.388404 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.388505 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.388714 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.388811 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.389022 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.389109 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.389332 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.389421 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.389640 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.389738 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.389943 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.390036 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.390257 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.390359 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.390558 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.390654 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.390888 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.390981 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.391207 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.391298 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.391514 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.391600 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.391820 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.391909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.392130 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.392217 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.392441 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.392529 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.392746 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.392840 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.393087 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.393210 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.393401 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.393621 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.393709 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.393963 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.394054 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.394302 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.394404 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.394609 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.394704 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.394949 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.395040 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.395265 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.395362 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.395589 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.395676 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.395896 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.395986 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.396211 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.396299 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.396516 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.396617 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.396819 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.396919 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.397123 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.397211 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.397430 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.397527 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.397733 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.397821 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.398036 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.398122 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.398335 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.398431 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.398636 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.398723 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.398962 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.399051 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.399267 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.399376 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.399573 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.399661 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.399873 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.399959 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.400175 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.400400 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.400492 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.400581 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.400785 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.400872 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.401092 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.401181 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.401398 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.401493 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.401701 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.401789 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.402004 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.402092 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.402353 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.402447 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.402658 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.402751 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.402995 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.403083 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.403305 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.403401 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.403616 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.403716 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.403925 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.404013 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.404235 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.404396 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.404551 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.404647 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.404858 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.404983 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.405166 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.405251 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.405725 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.405831 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.406032 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.406118 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.406347 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.406440 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.406655 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.406752 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.406984 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.407072 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.407295 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.407381 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.407618 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.407719 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.407931 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.408018 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.408249 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.408335 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.409093 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.409243 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.409478 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.409620 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.409794 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.409891 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.410106 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.410204 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.410424 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.410554 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.410736 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.410867 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.411073 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.411164 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.411446 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.411558 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.411700 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.411788 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.412018 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.412108 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.412327 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.412413 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.412641 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.412737 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.412948 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.413050 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.413263 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.413350 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.413566 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.413666 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.413878 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.413966 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.414199 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.414286 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.414513 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.414624 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.414844 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.414936 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.415149 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.415251 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.415464 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.415566 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.415771 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.415858 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.416079 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.416166 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.416389 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.416478 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.416697 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.416785 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.416999 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.417096 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.417306 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.417403 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.417613 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.417700 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.417918 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.418006 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.418222 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.418317 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.418521 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.418621 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.418848 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.418939 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.419159 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.419247 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.419460 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.419547 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.419762 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.419857 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.420063 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.420151 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.420375 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.420525 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.420684 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.420853 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.420985 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.421071 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.421287 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.421383 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.421598 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.421707 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.421898 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.421998 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.422211 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.422298 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.422516 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.422612 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.422842 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.422935 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.423146 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.423235 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.423447 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.423548 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.423769 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.423857 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.424077 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.424174 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.424451 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.424543 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.424721 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.424860 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.425021 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.425109 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.425363 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.425462 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.425673 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.425815 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.425975 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.426064 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.426279 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.426367 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.426596 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.426682 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.426926 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.427014 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.427238 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.427326 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.427545 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.427632 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.427850 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.427952 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.428157 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.428244 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.428468 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.428554 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.428779 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.428903 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.429083 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.429187 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.429388 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.429476 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.429692 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.429789 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.429995 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.430083 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.430304 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.430393 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.430639 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.430747 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.430964 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.431207 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.431296 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.431538 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.431653 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.431854 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.431953 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.432166 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.432261 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.432481 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.432734 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.432824 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.433066 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.433152 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.433380 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.433466 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.433695 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.433784 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.434014 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.434111 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.434331 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.434418 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.434632 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.434727 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.434964 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.435065 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.435271 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.435358 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.435574 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.435677 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.435878 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.436028 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.436178 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.436277 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.436484 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.436584 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.436783 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.436883 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.437083 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.437170 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.437383 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.437470 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.437697 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.437870 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.438203 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.438357 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.438498 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.438645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.438832 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.438923 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.439004 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.439096 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.439187 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.439278 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.439472 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.439561 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.440440 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.440757 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.440847 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.441050 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.441050 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.441226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.441315 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.441406 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.441599 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.441702 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.441903 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.441990 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.442206 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.442294 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.442511 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.442600 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.442876 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.442968 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.443188 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.443288 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.443513 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.443603 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.443817 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.443914 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.444121 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.444211 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.444424 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.444514 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.444732 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.444820 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.445040 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.445219 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.445341 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.445468 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.445649 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.445736 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.445950 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.446088 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.446256 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.446344 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.446561 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.446656 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.446887 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.447051 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.447196 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.447283 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.447496 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.447635 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.447803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.447906 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.448109 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.448202 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.448409 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.448497 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.448708 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.448795 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.449006 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.449092 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.449308 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.449396 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.449611 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.449700 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.449910 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.449996 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.450210 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.450296 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.450518 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.450610 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.450841 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.450933 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.451145 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.451243 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.451443 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.451531 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.451743 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.451837 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.452047 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.452135 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.452348 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.452445 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.452648 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.452735 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.452950 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.453046 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.453253 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.453339 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.453567 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.453667 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.453853 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.453948 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.454152 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.454238 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.454453 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.454541 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.454759 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.454887 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.455085 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.455204 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.455411 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.456177 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.456252 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.456362 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.456590 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.456747 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.456917 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.457065 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.457210 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.457354 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.457499 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.457645 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.457808 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.457947 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.458111 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.458250 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.458413 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.458574 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.458713 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.458877 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.459027 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.459164 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.459323 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.459461 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.459641 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.459779 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.459925 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.460060 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.460230 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.460367 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.460513 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.460706 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.460839 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.460998 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.461131 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.461273 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.461434 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.461530 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.461734 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.461821 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.462036 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.462133 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.462338 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.462435 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.462681 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.462820 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.463015 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.463120 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.463328 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.463434 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.463640 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.463728 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.463941 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.464037 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.464257 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.464346 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.464565 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.464658 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.464876 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.464963 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.465182 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.465293 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.465482 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.465579 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.465798 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.465896 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.466105 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.466202 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.466413 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.466510 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.466713 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.466830 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.467041 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.467132 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.467361 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.467449 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.467661 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.467756 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.467968 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.468053 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.468274 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.468362 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.468578 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.468677 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.468883 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.468971 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.469188 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.469275 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.469494 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.469592 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.469801 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.469895 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.470104 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.470190 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.470411 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.470511 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.470718 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.470829 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.471088 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.471252 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.471396 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.471642 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.471745 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.471839 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.471988 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.472078 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.472298 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.472388 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.472603 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.472690 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.472907 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.472995 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.473212 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.473308 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.473514 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.473601 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.473822 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.473910 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.474125 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.474216 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.474426 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.474549 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.474734 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.474865 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.475060 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.475179 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.475372 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.475473 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.475675 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.475772 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.476072 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.476159 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.476387 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.476496 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.476694 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.476799 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.476999 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.477094 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.477306 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.477413 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.477616 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.477713 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.477932 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.478020 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.478247 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.478334 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.478550 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.478640 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.478916 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.479008 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.479228 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.479317 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.479549 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.479646 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.479853 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.479949 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.480154 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.480242 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.480457 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.480546 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.480764 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.480859 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.481069 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.481203 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.481376 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.481507 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.481678 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.481788 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.481983 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.482080 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.482306 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.482394 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.482617 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.482811 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.482965 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.483125 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.483382 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.483471 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.483692 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.483780 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.483999 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.484096 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.484349 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.484436 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.484652 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.484740 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.484965 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.485067 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.485272 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.485359 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.485594 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.485705 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.485914 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.486021 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.486221 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.486332 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.486528 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.486625 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.486891 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.487002 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.487217 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.487326 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.487541 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.487647 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.487850 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.487948 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.488161 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.488267 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.488465 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.488656 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.488789 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.488981 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.489108 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.489296 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.489420 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.489621 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.489740 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.489947 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.490156 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.490255 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.490471 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.490558 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.490818 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.490939 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.491125 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.491248 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.491448 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.491583 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.491752 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.491849 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.492068 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.492168 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.492371 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.492460 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.492675 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.492773 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.492978 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.493075 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.493280 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.493368 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.493586 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.493728 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.493892 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.493997 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.494197 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.494292 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.494501 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.494589 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.494834 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.494945 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.495144 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.495243 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.495461 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.495567 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.495763 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.495868 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.496079 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.496175 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.496385 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.496483 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.496688 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.496786 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.496995 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.497093 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.497296 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.497436 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.497612 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.497751 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.497919 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.498071 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.498208 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.498346 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.498503 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.498640 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.498807 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.498952 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.499148 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.499287 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.499455 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.499595 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.499775 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.499923 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.500100 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.500237 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.500416 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.500565 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.500722 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.500870 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.501016 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.501159 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.501318 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.501478 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.501636 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.501724 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.501921 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.502032 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.502223 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.502871 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.503074 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.503322 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.503415 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.503507 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.503673 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.503763 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.503979 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.504070 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.504280 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.504368 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.504604 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.504693 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.504909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.505015 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.505221 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.505319 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.505522 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.505623 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.505823 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.505914 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.506126 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.506215 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.506427 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.506529 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.506747 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.506884 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.507078 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.507168 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.507383 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.507481 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.507688 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.507776 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.507990 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.508077 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.508335 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.508432 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.508641 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.508728 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.508962 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.509057 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.509278 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.509367 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.509591 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.509677 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.509905 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.509993 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.510211 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.510308 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.510521 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.510608 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.510859 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.510962 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.511174 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.511262 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.511483 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.511572 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.511796 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.511893 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.512108 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.512200 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.512423 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.512512 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.512737 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.512940 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.513031 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.513268 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.513356 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.513582 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.513670 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.513895 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.513987 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.514206 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.514454 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.514543 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.514801 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.514906 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.515122 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.515211 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.515429 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.515518 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.515739 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.515881 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.516047 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.516138 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.516358 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.516444 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.516671 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.516760 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.516984 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.517075 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.517294 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.517391 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.517606 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.517698 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.517962 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.518555 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.518844 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.518939 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.519163 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.519261 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.519496 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.519583 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.519813 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.519915 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.520119 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.520208 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.520430 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.520518 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.520741 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.520836 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.521054 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.521143 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.521364 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.521453 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.521674 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.521807 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.521985 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.522074 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.522296 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.522397 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.522605 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.522697 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.522937 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.523246 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.523348 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.523556 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.523644 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.523864 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.523959 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.524174 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.524272 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.524481 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.524578 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.524793 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.524882 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.525101 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.525241 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.525420 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.525510 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.525748 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.525931 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.526068 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.526244 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.526398 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.526577 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.526692 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.526925 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.527105 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.527249 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.527569 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.527664 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.527886 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.527982 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.528212 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.528302 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.528518 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.528615 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.528827 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.528969 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.529144 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.529241 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.529432 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.529528 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.529734 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.529833 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.530055 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.530157 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.530358 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.530715 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.530951 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.531103 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.531258 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.531349 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.531562 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.531658 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.531891 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.532088 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.532194 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.532439 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.532540 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.532754 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.532843 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.533080 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.533170 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.533406 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.533657 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.533781 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.534091 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.534240 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.534416 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.534537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.534723 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.534893 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.535053 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.535239 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.535407 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.535572 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.535714 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.535853 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.536015 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.536153 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.536298 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.536437 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.536575 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.536722 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.536867 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.537036 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.537171 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.537347 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.537487 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.537655 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.537794 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.537963 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.538102 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.538273 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.538413 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.538582 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.538723 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.538908 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.538998 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.539219 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.539309 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.539524 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.539614 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.539848 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.539936 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.540151 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.540238 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.540451 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.540540 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.540752 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.540848 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.541052 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.541152 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.541356 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.541444 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.541658 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.541746 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.541960 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.542055 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.542261 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.542349 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.542570 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.542667 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.542892 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.542997 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.543202 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.543291 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.543508 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.543596 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.543821 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.543918 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.544127 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.544222 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.544434 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.544528 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.544756 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.544846 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.545069 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.545157 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.545380 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.545488 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.545685 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.545783 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.545999 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.546120 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.546306 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.546533 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.546634 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.546897 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.546990 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.547225 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.547316 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.547557 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.547655 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.547887 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.547974 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.548192 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.548418 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.548582 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.548752 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.548840 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.549073 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.549194 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.549421 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.549532 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.549732 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.549831 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.550039 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.550128 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.550348 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.550447 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.550657 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.550745 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.550992 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.551081 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.551299 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.551401 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.551607 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.551703 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.551914 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.552003 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.552222 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.552313 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.552534 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.552687 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.552835 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.552971 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.553119 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.553259 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.553433 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.553591 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.553734 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.553821 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.554036 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.554126 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.554346 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.554435 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.554656 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.554753 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.554988 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.555076 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.555296 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.555382 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.555608 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.555732 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.555913 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.556003 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.556218 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.556306 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.556532 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.556633 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.556846 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.556941 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.557155 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.557247 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.557462 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.557557 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.557767 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.557876 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.558074 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.558187 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.558388 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.558487 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.558718 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.558856 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.559053 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.559141 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.559359 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.559449 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.559739 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.559827 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.560049 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.560151 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.560368 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.560458 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.560676 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.560805 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.560981 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.561078 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.561306 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.561403 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.561627 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.561716 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.561938 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.562035 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.562241 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.562327 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.562544 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.562633 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.562872 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.562966 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.563181 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.563269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.563497 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.563586 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.563804 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.563894 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.564108 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.564204 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.564411 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.564627 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.564745 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.565626 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.565626 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.565853 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.565939 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.566029 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.566120 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.566202 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.566389 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.566486 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.566696 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.566832 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.567026 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.567116 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.567329 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.567418 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.567631 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.567727 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.567937 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.568028 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.568239 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.568326 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.568541 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.568640 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.568842 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.568931 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.569143 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.569230 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.569444 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.569544 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.569745 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.569842 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.570047 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.570142 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.570346 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.570438 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.570650 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.570738 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.570979 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.571082 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.571283 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.571373 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.571591 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.571679 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.571898 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.571988 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.572201 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.572291 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.572518 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.572605 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.572883 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.572987 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.573152 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.573239 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.573463 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.573551 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.573768 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.573866 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.574087 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.574174 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.574394 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.574481 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.574703 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.574829 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.575043 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.575142 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.575352 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.575441 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.575656 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.575751 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.575963 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.576068 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.576281 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.576370 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.576593 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.576690 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.576897 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.576985 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.577204 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.577291 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.577512 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.577609 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.577821 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.577917 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.578132 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.578226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.578441 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.578539 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.578748 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.578867 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.579088 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.579184 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.579397 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.579487 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.579706 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.579802 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.580016 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.580113 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.580324 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.580429 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.581201 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.581356 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.581521 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.581647 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.581834 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.581965 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.582145 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.582287 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.582454 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.582605 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.582783 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.582962 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.583104 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.583293 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.583415 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.583605 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.583727 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.583934 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.584043 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.584261 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.584360 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.584606 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.584695 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.584920 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.585008 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.585264 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.585366 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.585589 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.585677 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.585904 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.585999 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.586217 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.586318 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.586524 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.586614 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.586793 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103721) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 12:09:17.586914 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.587212 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.587531 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.587843 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.588149 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:09:17.588391 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103720) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 12:09:17.648172 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Registered counter for database nova_api Jul 14 12:09:17.650216 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO dbcounter [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Registered counter for database nova_api Jul 14 12:09:17.761843 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:09:17.763407 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG oslo_db.sqlalchemy.engines [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:09:17.768761 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:09:17.770528 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG dbcounter [-] [103720] Writer thread running {{(pid=103720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:09:17.825196 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.context [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e(cell1) {{(pid=103721) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 12:09:17.826490 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.context [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e(cell1) {{(pid=103720) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 12:09:17.829063 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:09:17.830915 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG oslo_concurrency.lockutils [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:09:17.831332 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:09:17.832117 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:09:17.832850 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG oslo_concurrency.lockutils [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:09:17.833656 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG oslo_concurrency.lockutils [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:09:17.834231 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:09:17.835795 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG oslo_concurrency.lockutils [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103720) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:09:17.836229 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Registered counter for database nova_cell0 Jul 14 12:09:17.837766 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO dbcounter [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Registered counter for database nova_cell0 Jul 14 12:09:17.840213 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Registered counter for database nova_cell1 Jul 14 12:09:17.841578 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO dbcounter [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Registered counter for database nova_cell1 Jul 14 12:09:17.848082 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:09:17.849814 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG oslo_db.sqlalchemy.engines [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:09:17.851454 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:09:17.853618 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG oslo_db.sqlalchemy.engines [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:09:17.856013 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:09:17.857990 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG dbcounter [-] [103720] Writer thread running {{(pid=103720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:09:17.863526 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG dbcounter [-] [103720] Writer thread running {{(pid=103720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:09:17.999034 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:09:18.009749 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO dbcounter [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Registered counter for database nova_cell0 Jul 14 12:09:18.017046 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO dbcounter [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Registered counter for database nova_cell0 Jul 14 12:09:18.019152 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_db.sqlalchemy.engines [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103721) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:09:18.023660 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writer thread running {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:09:18.026358 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG oslo_db.sqlalchemy.engines [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103720) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:09:18.031216 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG dbcounter [-] [103720] Writer thread running {{(pid=103720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:09:18.421050 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 12:09:18.428856 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 12:09:18.477528 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: WARNING keystonemiddleware.auth_token [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 12:09:18.484945 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: WARNING keystonemiddleware.auth_token [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 12:09:18.768798 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 12:09:18.775080 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: WARNING keystonemiddleware.auth_token [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 12:09:18.780740 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558e8c7cc9c0 pid: 103721 (default app) Jul 14 12:09:18.783020 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:09:18.784975 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002614 Jul 14 12:09:18.785453 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Thu Jul 14 12:09:18 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:09:18.831639 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: WARNING keystonemiddleware.auth_token [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 12:09:18.837650 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: WARNING keystonemiddleware.auth_token [None req-8ebdbf2a-c1df-4b6f-bba7-772871fd9322 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 12:09:18.842894 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558e8c7cc9c0 pid: 103720 (default app) Jul 14 12:10:37.937094 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:10:37.939447 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002683 Jul 14 12:10:37.940100 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:10:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:10:37.952377 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG dbcounter [-] [103720] Writing DB stats nova_api:SELECT=3 {{(pid=103720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:37.956251 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG dbcounter [-] [103720] Writing DB stats nova_cell1:SELECT=3 {{(pid=103720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:37.956251 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG dbcounter [-] [103720] Writing DB stats nova_cell0:SELECT=3 {{(pid=103720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:37.956420 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG dbcounter [-] [103720] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:38.827021 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-4b97a5eb-1e9d-4cce-9e0b-d4acd6cb532d admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:10:38.857681 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-4b97a5eb-1e9d-4cce-9e0b-d4acd6cb532d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910869 Jul 14 12:10:38.858556 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jul 14 12:10:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:10:41.093237 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:10:41.094224 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-10624511-0225-4aad-8559-27c09b2e4437 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jul 14 12:10:41.094976 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:10:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:10:41.575047 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-37ec1ebb-266a-4792-a062-a34110617448 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:41.593466 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:10:41.593466 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: warnings.warn(msg) Jul 14 12:10:41.696742 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-37ec1ebb-266a-4792-a062-a34110617448 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.596117 Jul 14 12:10:41.697477 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 12:10:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:10:41.714935 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=3 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:41.714935 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell0:SELECT=3 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:41.714935 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell1:SELECT=3 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:41.714935 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:10:41.932637 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-79875576-1a86-4216-9718-3a4c60f76a4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:41.935044 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:10:41.935044 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 12:10:42.054216 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-79875576-1a86-4216-9718-3a4c60f76a4f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.348426 Jul 14 12:10:42.054927 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jul 14 12:10:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:10:44.339148 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-37ec1ebb-266a-4792-a062-a34110617448 admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:10:44.340175 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-37ec1ebb-266a-4792-a062-a34110617448 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 14 12:10:44.340779 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:10:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:10:45.024306 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-b8df8fdd-af76-42dc-939c-3df2ee84c3ca admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 5, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:45.043107 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:10:45.043107 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 12:10:45.153447 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-b8df8fdd-af76-42dc-939c-3df2ee84c3ca admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.806202 Jul 14 12:10:45.155206 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 12:10:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:10:45.167313 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-9343d7de-2731-43cb-86ee-cb83033d3142 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:45.168970 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:10:45.168970 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: warnings.warn(msg) Jul 14 12:10:45.256686 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-9343d7de-2731-43cb-86ee-cb83033d3142 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092891 Jul 14 12:10:45.257484 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jul 14 12:10:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:10:47.484163 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-b8df8fdd-af76-42dc-939c-3df2ee84c3ca admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:10:47.485985 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-b8df8fdd-af76-42dc-939c-3df2ee84c3ca admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Jul 14 12:10:47.487000 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:10:47 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:10:47.904888 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-09a45499-1822-4c43-95de-d841facb0e16 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:47.970079 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-09a45499-1822-4c43-95de-d841facb0e16 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475022 Jul 14 12:10:47.970624 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 12:10:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:10:47.982218 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-e0896916-f04d-4902-8030-09dec08e32a3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:48.052969 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-e0896916-f04d-4902-8030-09dec08e32a3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074350 Jul 14 12:10:48.053537 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jul 14 12:10:47 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:10:50.343736 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-09a45499-1822-4c43-95de-d841facb0e16 admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:10:50.343736 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-09a45499-1822-4c43-95de-d841facb0e16 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 14 12:10:50.343736 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:10:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:10:50.743554 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-a6785ee9-cad8-417f-9457-9a40dfea52cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "swap": 0, "vcpus": 2, "disk": 10, "id": "d3"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:50.825497 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-a6785ee9-cad8-417f-9457-9a40dfea52cf admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502193 Jul 14 12:10:50.826333 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 12:10:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 12:10:50.838665 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-01e66e1a-ddc9-40bb-8a6b-34a41ab7e69a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:50.920086 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-01e66e1a-ddc9-40bb-8a6b-34a41ab7e69a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085167 Jul 14 12:10:50.920695 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jul 14 12:10:50 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:10:53.180682 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-a6785ee9-cad8-417f-9457-9a40dfea52cf admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:10:53.187134 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-a6785ee9-cad8-417f-9457-9a40dfea52cf admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jul 14 12:10:53.187134 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:10:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:10:53.591359 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-6924a197-cff0-4d01-898a-250da245ea7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "vcpus": 4, "id": "d4", "rxtx_factor": 1.0}} {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:53.662261 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-6924a197-cff0-4d01-898a-250da245ea7b admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474473 Jul 14 12:10:53.663154 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 12:10:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:10:53.675566 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-63ba824a-1e95-46c9-a633-cc6bebe707ef admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:53.763873 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-63ba824a-1e95-46c9-a633-cc6bebe707ef admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092725 Jul 14 12:10:53.764757 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1335 bytes} [Thu Jul 14 12:10:53 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:10:56.064851 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-6924a197-cff0-4d01-898a-250da245ea7b admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:10:56.065871 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-6924a197-cff0-4d01-898a-250da245ea7b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jul 14 12:10:56.066273 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:10:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:10:56.534525 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-0f2d0bcf-eefe-4f7e-935e-2bb508cdd0d3 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:10:56.560160 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-0f2d0bcf-eefe-4f7e-935e-2bb508cdd0d3 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.487761 Jul 14 12:10:56.560752 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jul 14 12:10:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:10:59.072325 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-6924a197-cff0-4d01-898a-250da245ea7b admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:10:59.073505 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-6924a197-cff0-4d01-898a-250da245ea7b admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001674 Jul 14 12:10:59.073954 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:10:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:10:59.502110 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-af1c7868-b928-4b91-91e7-84f5179a9c2c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 512, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:59.571808 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-af1c7868-b928-4b91-91e7-84f5179a9c2c admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.491452 Jul 14 12:10:59.572445 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 12:10:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:10:59.587042 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-fdeab2e8-cd55-4a06-a9d8-56dc4c6c00ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:10:59.657771 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-fdeab2e8-cd55-4a06-a9d8-56dc4c6c00ce admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075146 Jul 14 12:10:59.658429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jul 14 12:10:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:11:01.990522 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-af1c7868-b928-4b91-91e7-84f5179a9c2c admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:01.991630 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-af1c7868-b928-4b91-91e7-84f5179a9c2c admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jul 14 12:11:01.992085 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:11:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:02.386982 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-5765a15a-119b-4757-b887-e45e817c063d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "vcpus": 1, "id": "2"}} {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:02.596384 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-5765a15a-119b-4757-b887-e45e817c063d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.598300 Jul 14 12:11:02.596900 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 12:11:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:11:02.609058 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-1454e4ac-9314-478f-ae83-2e2c31708220 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:02.681706 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-1454e4ac-9314-478f-ae83-2e2c31708220 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076304 Jul 14 12:11:02.682282 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jul 14 12:11:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:11:04.928555 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-5765a15a-119b-4757-b887-e45e817c063d admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:04.929581 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-5765a15a-119b-4757-b887-e45e817c063d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jul 14 12:11:04.929987 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:11:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:05.293988 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-6199096e-043e-453f-8c49-62ea079a4815 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "3", "name": "m1.medium", "ram": 4096, "disk": 40}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:05.358245 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-6199096e-043e-453f-8c49-62ea079a4815 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.422345 Jul 14 12:11:05.358807 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 12:11:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:11:05.371871 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-ecf408be-2e9a-4589-b524-3f83e2941a87 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:05.435318 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-ecf408be-2e9a-4589-b524-3f83e2941a87 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067031 Jul 14 12:11:05.435829 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jul 14 12:11:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:11:07.676021 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-6199096e-043e-453f-8c49-62ea079a4815 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:07.677737 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-6199096e-043e-453f-8c49-62ea079a4815 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002191 Jul 14 12:11:07.678136 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:11:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:08.123679 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-9305fcf4-b999-4bd2-8211-222d1e51fcb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4, "swap": 0, "id": "4", "ram": 8192}} {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:08.133211 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG dbcounter [-] [103720] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:11:08.210953 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-9305fcf4-b999-4bd2-8211-222d1e51fcb2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.526979 Jul 14 12:11:08.211616 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 12:11:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:11:08.223701 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-696f6f96-a13a-4e0f-9abc-bf6808b056da admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:08.362843 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-696f6f96-a13a-4e0f-9abc-bf6808b056da admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.142757 Jul 14 12:11:08.363767 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jul 14 12:11:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:11:10.650352 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-9305fcf4-b999-4bd2-8211-222d1e51fcb2 admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:10.652018 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-9305fcf4-b999-4bd2-8211-222d1e51fcb2 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Jul 14 12:11:10.652512 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:11:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:11.100183 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-26553b1b-b507-4ab0-9091-03299b9a0fe9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:11.173825 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-26553b1b-b507-4ab0-9091-03299b9a0fe9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.514265 Jul 14 12:11:11.174553 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1282 bytes} [Thu Jul 14 12:11:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 12:11:11.188636 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-15246fef-b7da-4aa3-81e7-c2c490939ab0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:11.279637 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-15246fef-b7da-4aa3-81e7-c2c490939ab0 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096716 Jul 14 12:11:11.280401 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1332 bytes} [Thu Jul 14 12:11:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:11:31.512085 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-26553b1b-b507-4ab0-9091-03299b9a0fe9 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:31.513090 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-26553b1b-b507-4ab0-9091-03299b9a0fe9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 14 12:11:31.513484 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:11:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:31.901243 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-9a625c05-8702-414e-8842-980d5576cdcd admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:31.918110 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-9a625c05-8702-414e-8842-980d5576cdcd admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398131 Jul 14 12:11:31.918636 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jul 14 12:11:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:11:32.985390 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-26553b1b-b507-4ab0-9091-03299b9a0fe9 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:32.986422 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-26553b1b-b507-4ab0-9091-03299b9a0fe9 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 14 12:11:32.986836 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:11:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:33.506417 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-c03f4fc3-325c-43eb-ad84-9b580a22ae7c admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:33.512016 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.wsgi [None req-c03f4fc3-325c-43eb-ad84-9b580a22ae7c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-c03f4fc3-325c-43eb-ad84-9b580a22ae7c admin admin] Request method failure captured: Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Accept: application/json Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Accept-Encoding: gzip, deflate Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Connection: keep-alive Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Content-Length: 0 Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Host: 10.222.0.27 Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Openstack-Api-Version: compute 2.90 Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Openstack-System-Scope: None Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: User-Agent: python-novaclient Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Auth-Token: gAAAAABi0Af0Jj4HGWzGiRSgddsEf8mc-0kT6tc6yquKzVB24u18MtLEF4YolhaBOWY5t_4RvMWGWrKJFDYSV5BnJXvUJ708EyRlHsuq-_c5XjNEJGXPFFnzmU8Ix5Sl5RjQ6oJvDwwRJQ6gKj96Mqsc6jMtvS7D_kDGSMvcCcsU8FddEGyyIHA Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Domain-Id: None Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Domain-Name: None Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Identity-Status: Confirmed Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Is-Admin-Project: True Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Domain-Id: default Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Domain-Name: Default Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Name: admin Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Role: reader,admin,member Jul 14 12:11:33.515920 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Roles: reader,admin,member Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1074c03ef1614e229d46654abff5220e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1074c03ef1614e229d46654abff5220e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Tenant: admin Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Tenant-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Tenant-Name: admin Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User: admin Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Domain-Id: default Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Domain-Name: Default Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Id: 984129f5bec74f43b4a666f392319525 Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Name: admin Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: method: > Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: exception: Flavor 42 could not be found. Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: action_args: {'id': '42'} Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:11:33.517548 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:33.518537 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:33.520048 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-c03f4fc3-325c-43eb-ad84-9b580a22ae7c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:11:33.521368 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-c03f4fc3-325c-43eb-ad84-9b580a22ae7c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.393935 Jul 14 12:11:33.521368 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jul 14 12:11:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:33.527144 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-68676d99-06f3-497a-af69-9d5fd1117042 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:33.530018 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:11:33.549465 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-68676d99-06f3-497a-af69-9d5fd1117042 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025951 Jul 14 12:11:33.549995 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 12:11:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:11:33.559507 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-de8d52f5-b9f0-430d-8558-5fe33dc3456d admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:33.581451 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-de8d52f5-b9f0-430d-8558-5fe33dc3456d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025434 Jul 14 12:11:33.582014 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 12:11:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:11:33.591472 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-36a86932-ead1-44a4-b078-2d725e9fd63f admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:33.598500 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.wsgi [None req-36a86932-ead1-44a4-b078-2d725e9fd63f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-36a86932-ead1-44a4-b078-2d725e9fd63f admin admin] Request method failure captured: Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Accept: application/json Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Accept-Encoding: gzip, deflate Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Connection: keep-alive Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Content-Length: 0 Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Host: 10.222.0.27 Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Openstack-Api-Version: compute 2.90 Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Openstack-System-Scope: None Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: User-Agent: python-novaclient Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Auth-Token: gAAAAABi0Af0Jj4HGWzGiRSgddsEf8mc-0kT6tc6yquKzVB24u18MtLEF4YolhaBOWY5t_4RvMWGWrKJFDYSV5BnJXvUJ708EyRlHsuq-_c5XjNEJGXPFFnzmU8Ix5Sl5RjQ6oJvDwwRJQ6gKj96Mqsc6jMtvS7D_kDGSMvcCcsU8FddEGyyIHA Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Domain-Id: None Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Domain-Name: None Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Identity-Status: Confirmed Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Is-Admin-Project: True Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Domain-Id: default Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Domain-Name: Default Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Name: admin Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Role: reader,admin,member Jul 14 12:11:33.601816 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Roles: reader,admin,member Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1074c03ef1614e229d46654abff5220e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1074c03ef1614e229d46654abff5220e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Tenant: admin Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Tenant-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Tenant-Name: admin Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User: admin Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Domain-Id: default Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Domain-Name: Default Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Id: 984129f5bec74f43b4a666f392319525 Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Name: admin Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: method: > Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: exception: Flavor 42 could not be found. Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: action_args: {'id': '42'} Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:11:33.608598 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:33.609597 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:33.610909 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-36a86932-ead1-44a4-b078-2d725e9fd63f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:11:33.612208 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-36a86932-ead1-44a4-b078-2d725e9fd63f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015382 Jul 14 12:11:33.612208 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jul 14 12:11:33 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:34.575803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-de8d52f5-b9f0-430d-8558-5fe33dc3456d admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:34.576812 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-de8d52f5-b9f0-430d-8558-5fe33dc3456d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 14 12:11:34.577872 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:11:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:35.094285 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-72d5f698-f7e8-4617-bab6-51651bb500c0 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:35.100135 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.wsgi [None req-72d5f698-f7e8-4617-bab6-51651bb500c0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-72d5f698-f7e8-4617-bab6-51651bb500c0 admin admin] Request method failure captured: Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Accept: application/json Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Accept-Encoding: gzip, deflate Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Connection: keep-alive Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Content-Length: 0 Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Host: 10.222.0.27 Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Openstack-Api-Version: compute 2.90 Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Openstack-System-Scope: None Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: User-Agent: python-novaclient Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Auth-Token: gAAAAABi0Af2CvgEOENAjaSQY6MbF1AW2qyhAYY49KvilIb1BDeuJoxWVsTC9T9u7xgU4ke5Y7Eu7lAmYTWTpm0pv1jOTKsY7IweT888R8kxOJoA54Esh4z8d-Z0U-nntDSRGX16LM6wec6UfA0kBaGcj7Odw_iyAsigtEv92zccawMsqE73uNI Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Domain-Id: None Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Domain-Name: None Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Identity-Status: Confirmed Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Is-Admin-Project: True Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Domain-Id: default Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Domain-Name: Default Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Name: admin Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Role: reader,admin,member Jul 14 12:11:35.101645 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Roles: reader,admin,member Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1074c03ef1614e229d46654abff5220e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1074c03ef1614e229d46654abff5220e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Tenant: admin Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Tenant-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Tenant-Name: admin Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User: admin Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Domain-Id: default Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Domain-Name: Default Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Id: 984129f5bec74f43b4a666f392319525 Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Name: admin Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: method: > Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: exception: Flavor 84 could not be found. Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: action_args: {'id': '84'} Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:11:35.103220 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:35.104263 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:35.105644 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-72d5f698-f7e8-4617-bab6-51651bb500c0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:11:35.106923 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-72d5f698-f7e8-4617-bab6-51651bb500c0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389112 Jul 14 12:11:35.106923 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jul 14 12:11:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:35.113190 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-09b1b612-f728-460b-b94c-79d6e05b6a87 admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:35.127475 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-09b1b612-f728-460b-b94c-79d6e05b6a87 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017889 Jul 14 12:11:35.128000 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 12:11:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:11:35.137330 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-f15edc20-bbc7-4a60-86fe-c059e1f4c8f7 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:35.150745 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-f15edc20-bbc7-4a60-86fe-c059e1f4c8f7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016973 Jul 14 12:11:35.151277 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 12:11:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:11:35.160502 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-a3d4a709-ccb1-45a6-b26a-6bf97679b6fa admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:35.165732 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.wsgi [None req-a3d4a709-ccb1-45a6-b26a-6bf97679b6fa admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-a3d4a709-ccb1-45a6-b26a-6bf97679b6fa admin admin] Request method failure captured: Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Accept: application/json Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Accept-Encoding: gzip, deflate Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Connection: keep-alive Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Content-Length: 0 Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Host: 10.222.0.27 Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Openstack-Api-Version: compute 2.90 Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Openstack-System-Scope: None Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: User-Agent: python-novaclient Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Auth-Token: gAAAAABi0Af2CvgEOENAjaSQY6MbF1AW2qyhAYY49KvilIb1BDeuJoxWVsTC9T9u7xgU4ke5Y7Eu7lAmYTWTpm0pv1jOTKsY7IweT888R8kxOJoA54Esh4z8d-Z0U-nntDSRGX16LM6wec6UfA0kBaGcj7Odw_iyAsigtEv92zccawMsqE73uNI Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Domain-Id: None Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Domain-Name: None Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Identity-Status: Confirmed Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Is-Admin-Project: True Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Domain-Id: default Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Domain-Name: Default Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Name: admin Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Role: reader,admin,member Jul 14 12:11:35.167269 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Roles: reader,admin,member Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1074c03ef1614e229d46654abff5220e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1074c03ef1614e229d46654abff5220e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Tenant: admin Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Tenant-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Tenant-Name: admin Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User: admin Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Domain-Id: default Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Domain-Name: Default Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Id: 984129f5bec74f43b4a666f392319525 Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Name: admin Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: method: > Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: exception: Flavor 84 could not be found. Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: action_args: {'id': '84'} Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:11:35.168803 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:35.169698 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:35.171790 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-a3d4a709-ccb1-45a6-b26a-6bf97679b6fa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:11:35.173159 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-a3d4a709-ccb1-45a6-b26a-6bf97679b6fa admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011873 Jul 14 12:11:35.173159 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Thu Jul 14 12:11:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:36.149164 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-f15edc20-bbc7-4a60-86fe-c059e1f4c8f7 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:36.150172 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-f15edc20-bbc7-4a60-86fe-c059e1f4c8f7 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Jul 14 12:11:36.150563 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:11:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:36.669877 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-f7fe5516-2330-4139-9869-88c8776cdbba admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:36.676568 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.wsgi [None req-f7fe5516-2330-4139-9869-88c8776cdbba admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-f7fe5516-2330-4139-9869-88c8776cdbba admin admin] Request method failure captured: Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Accept: application/json Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Accept-Encoding: gzip, deflate Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Connection: keep-alive Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Content-Length: 0 Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Host: 10.222.0.27 Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Openstack-Api-Version: compute 2.90 Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Openstack-System-Scope: None Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: User-Agent: python-novaclient Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Auth-Token: gAAAAABi0Af4hrm6iJeXPD42qApBbzPYbNYDbafy0-YbV9wxP7Ap7wB8synrVAoM0vQ_zAaSl5RZ7ohBG4s041Kfho4veTCOuzGBMUZVCj6A4PO2E3i81lK7GqdIEGpKskAengncI1g0QbccYvs1-JWbgII8SJqYExLeKRqbVewfoqj-PVCDV-8 Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Domain-Id: None Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Domain-Name: None Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Identity-Status: Confirmed Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Is-Admin-Project: True Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Domain-Id: default Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Domain-Name: Default Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Project-Name: admin Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Role: reader,admin,member Jul 14 12:11:36.678052 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Roles: reader,admin,member Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1074c03ef1614e229d46654abff5220e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1074c03ef1614e229d46654abff5220e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Tenant: admin Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Tenant-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-Tenant-Name: admin Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User: admin Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Domain-Id: default Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Domain-Name: Default Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Id: 984129f5bec74f43b4a666f392319525 Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: X-User-Name: admin Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: method: > Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: exception: Flavor 451 could not be found. Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: action_args: {'id': '451'} Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:11:36.679429 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:36.680226 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: ERROR nova.api.openstack.wsgi Jul 14 12:11:36.681460 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-f7fe5516-2330-4139-9869-88c8776cdbba admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103720) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:11:36.682678 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-f7fe5516-2330-4139-9869-88c8776cdbba admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.391384 Jul 14 12:11:36.682678 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 12:11:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 12:11:36.689619 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-0fbb7dde-6bbe-4a5a-aa64-67ed9d9b1de7 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:36.703175 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-0fbb7dde-6bbe-4a5a-aa64-67ed9d9b1de7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017713 Jul 14 12:11:36.703703 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 12:11:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:11:36.712849 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:36.727808 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018373 Jul 14 12:11:36.728359 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Thu Jul 14 12:11:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:11:36.738416 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-6885999e-f3bb-4e61-a31c-e96186727818 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:36.743744 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.wsgi [None req-6885999e-f3bb-4e61-a31c-e96186727818 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-6885999e-f3bb-4e61-a31c-e96186727818 admin admin] Request method failure captured: Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Accept: application/json Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Accept-Encoding: gzip, deflate Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Connection: keep-alive Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Content-Length: 0 Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Host: 10.222.0.27 Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Openstack-Api-Version: compute 2.90 Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Openstack-System-Scope: None Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: User-Agent: python-novaclient Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Auth-Token: gAAAAABi0Af4hrm6iJeXPD42qApBbzPYbNYDbafy0-YbV9wxP7Ap7wB8synrVAoM0vQ_zAaSl5RZ7ohBG4s041Kfho4veTCOuzGBMUZVCj6A4PO2E3i81lK7GqdIEGpKskAengncI1g0QbccYvs1-JWbgII8SJqYExLeKRqbVewfoqj-PVCDV-8 Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Domain-Id: None Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Domain-Name: None Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Identity-Status: Confirmed Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Is-Admin-Project: True Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Domain-Id: default Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Domain-Name: Default Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Project-Name: admin Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Role: reader,admin,member Jul 14 12:11:36.745327 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Roles: reader,admin,member Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1074c03ef1614e229d46654abff5220e", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1074c03ef1614e229d46654abff5220e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1074c03ef1614e229d46654abff5220e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Tenant: admin Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Tenant-Id: 1074c03ef1614e229d46654abff5220e Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-Tenant-Name: admin Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User: admin Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Domain-Id: default Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Domain-Name: Default Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Id: 984129f5bec74f43b4a666f392319525 Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: X-User-Name: admin Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: method: > Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: exception: Flavor 451 could not be found. Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: action_args: {'id': '451'} Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:11:36.746885 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:36.747943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: ERROR nova.api.openstack.wsgi Jul 14 12:11:36.750314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-6885999e-f3bb-4e61-a31c-e96186727818 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103721) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:11:36.751590 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-6885999e-f3bb-4e61-a31c-e96186727818 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011920 Jul 14 12:11:36.751590 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 12:11:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 12:11:37.716902 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:37.717937 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jul 14 12:11:37.718364 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:11:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:38.238968 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-6e0937ad-2bd0-4d56-b253-cbdc94c8a5a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:38.321187 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-6e0937ad-2bd0-4d56-b253-cbdc94c8a5a8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.464265 Jul 14 12:11:38.321740 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jul 14 12:11:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:11:39.292206 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:39.293205 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 14 12:11:39.293588 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:39.816710 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-ee6f8a39-05b0-4ce3-b168-b33e19936bf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:39.905771 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-ee6f8a39-05b0-4ce3-b168-b33e19936bf8 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.473770 Jul 14 12:11:39.906314 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jul 14 12:11:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:11:40.887449 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:40.888459 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001790 Jul 14 12:11:40.888887 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:11:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:41.409922 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-b124c704-a354-4f01-85ef-426d945ea801 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:41.490365 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-b124c704-a354-4f01-85ef-426d945ea801 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.464743 Jul 14 12:11:41.490984 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jul 14 12:11:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:11:42.447886 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:42.448936 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 14 12:11:42.449342 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:11:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:42.970163 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-f6529796-9a15-406c-9ef5-145938810a2a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:11:43.042013 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-f6529796-9a15-406c-9ef5-145938810a2a admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.456077 Jul 14 12:11:43.042554 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Thu Jul 14 12:11:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:11:44.017945 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:44.019009 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jul 14 12:11:44.019398 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:11:44.530268 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-a3ea5c2e-f316-4e65-b963-78bb438b4c1f admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:11:44.550100 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-a3ea5c2e-f316-4e65-b963-78bb438b4c1f admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.397046 Jul 14 12:11:44.555040 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Thu Jul 14 12:11:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:12:37.034672 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:12:37.035704 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-e74fe1db-95b1-498c-951d-ab982da9898e admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001703 Jul 14 12:12:37.036092 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 930 bytes} [Thu Jul 14 12:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:12:37.046624 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:12:37.426056 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-6b5e7330-b7c3-4843-bfc9-7e7033d16e9e admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:12:37.445386 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-6b5e7330-b7c3-4843-bfc9-7e7033d16e9e admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403313 Jul 14 12:12:37.445925 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1291 bytes} [Thu Jul 14 12:12:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:12:37.466639 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG dbcounter [-] [103720] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103720) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:12:37.470338 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-0c19dba5-bc43-47f4-b5d6-7277a350c5f5 admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:12:37.477800 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-0c19dba5-bc43-47f4-b5d6-7277a350c5f5 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012775 Jul 14 12:12:37.478631 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1282 bytes} [Thu Jul 14 12:12:37 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:12:37.490160 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-9c452d60-3120-4f47-a03f-fed88ccdf9f7 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:12:37.498437 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-9c452d60-3120-4f47-a03f-fed88ccdf9f7 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011810 Jul 14 12:12:37.498986 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1285 bytes} [Thu Jul 14 12:12:37 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:12:37.510182 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-c375ee28-0126-4858-ad6d-5d389713ca79 admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:12:37.518384 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-c375ee28-0126-4858-ad6d-5d389713ca79 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011676 Jul 14 12:12:37.524446 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1285 bytes} [Thu Jul 14 12:12:37 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:12:37.530310 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-436a7f4d-39c1-45f8-9683-65c36921d837 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:12:37.538106 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-436a7f4d-39c1-45f8-9683-65c36921d837 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011650 Jul 14 12:12:37.538618 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1282 bytes} [Thu Jul 14 12:12:37 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:16:12.353696 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-c375ee28-0126-4858-ad6d-5d389713ca79 admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:16:12.354697 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-c375ee28-0126-4858-ad6d-5d389713ca79 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jul 14 12:16:12.355186 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:16:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:16:12.492992 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=6 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:12.652374 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-d2d2c887-264a-429c-93d4-8b06a86eb1a8 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:16:12.653545 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:16:12.653545 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 12:16:12.654740 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-d2d2c887-264a-429c-93d4-8b06a86eb1a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:16:12.655206 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-d2d2c887-264a-429c-93d4-8b06a86eb1a8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:16:12.655992 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-d2d2c887-264a-429c-93d4-8b06a86eb1a8 admin admin] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:16:12.656419 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-d2d2c887-264a-429c-93d4-8b06a86eb1a8 admin admin] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:16:12.691297 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-d2d2c887-264a-429c-93d4-8b06a86eb1a8 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199816 Jul 14 12:16:12.691858 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 12:16:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:16:13.545114 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-c375ee28-0126-4858-ad6d-5d389713ca79 admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:16:13.546190 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-c375ee28-0126-4858-ad6d-5d389713ca79 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jul 14 12:16:13.546586 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:16:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:16:13.754755 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-cd17f6ff-a887-4b3a-b147-14a5c6117821 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:16:13.754755 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:16:13.754755 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 12:16:13.756007 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-cd17f6ff-a887-4b3a-b147-14a5c6117821 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:16:13.756540 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-cd17f6ff-a887-4b3a-b147-14a5c6117821 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:16:13.758592 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-cd17f6ff-a887-4b3a-b147-14a5c6117821 admin admin] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:16:13.759054 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-cd17f6ff-a887-4b3a-b147-14a5c6117821 admin admin] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:16:13.781549 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-cd17f6ff-a887-4b3a-b147-14a5c6117821 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.084081 Jul 14 12:16:13.782095 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 12:16:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:16:25.026077 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-c375ee28-0126-4858-ad6d-5d389713ca79 admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:16:25.027113 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-c375ee28-0126-4858-ad6d-5d389713ca79 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 14 12:16:25.027510 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:16:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:16:25.171606 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell0:SELECT=4 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:25.172357 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_cell1:SELECT=4 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:25.174193 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG dbcounter [-] [103721] Writing DB stats nova_api:SELECT=8 {{(pid=103721) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:16:25.222027 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-eb7d51f8-0706-4083-93a7-065f8e47256e admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:16:25.223307 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:16:25.223307 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 12:16:25.224479 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-eb7d51f8-0706-4083-93a7-065f8e47256e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:16:25.224943 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-eb7d51f8-0706-4083-93a7-065f8e47256e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:16:25.225719 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-eb7d51f8-0706-4083-93a7-065f8e47256e admin admin] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:16:25.226142 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-eb7d51f8-0706-4083-93a7-065f8e47256e admin admin] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:16:25.251838 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-eb7d51f8-0706-4083-93a7-065f8e47256e admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.084518 Jul 14 12:16:25.252312 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 12:16:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:16:26.075555 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: DEBUG nova.api.openstack.wsgi [None req-c375ee28-0126-4858-ad6d-5d389713ca79 admin admin] Calling method '>' {{(pid=103720) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:16:26.076593 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: INFO nova.api.openstack.requestlog [None req-c375ee28-0126-4858-ad6d-5d389713ca79 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Jul 14 12:16:26.076990 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: [pid: 103720|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Thu Jul 14 12:16:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:16:26.267306 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG nova.api.openstack.wsgi [None req-e5d737fd-5b83-4c0a-8836-93e561d85127 admin admin] Calling method '>' {{(pid=103721) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:16:26.268486 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 12:16:26.268486 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: warnings.warn(msg) Jul 14 12:16:26.269658 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-e5d737fd-5b83-4c0a-8836-93e561d85127 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:16:26.270101 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-e5d737fd-5b83-4c0a-8836-93e561d85127 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:16:26.270916 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-e5d737fd-5b83-4c0a-8836-93e561d85127 admin admin] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:16:26.271344 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: DEBUG oslo_concurrency.lockutils [None req-e5d737fd-5b83-4c0a-8836-93e561d85127 admin admin] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103721) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:16:26.293054 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: INFO nova.api.openstack.requestlog [None req-e5d737fd-5b83-4c0a-8836-93e561d85127 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079038 Jul 14 12:16:26.293520 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: [pid: 103721|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Thu Jul 14 12:16:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:17:26.003286 dv-cinder-848900-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 12:17:26.003824 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: Thu Jul 14 12:17:26 2022 - graceful shutdown triggered... Jul 14 12:17:26.004249 dv-cinder-848900-3-iscsi devstack@n-api.service[103720]: Gracefully killing worker 1 (pid: 103720)... Jul 14 12:17:26.004770 dv-cinder-848900-3-iscsi devstack@n-api.service[103721]: Gracefully killing worker 2 (pid: 103721)... Jul 14 12:17:27.004719 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: worker 1 buried after 1 seconds Jul 14 12:17:27.004719 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: worker 2 buried after 1 seconds Jul 14 12:17:27.004719 dv-cinder-848900-3-iscsi devstack@n-api.service[103719]: goodbye to uWSGI. Jul 14 12:17:27.006280 dv-cinder-848900-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 12:17:27.006843 dv-cinder-848900-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 12:17:27.009644 dv-cinder-848900-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 12:17:27.021699 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 12:17:27.023718 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 12:17:27 2022] *** Jul 14 12:17:27.023718 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 12:17:27.023718 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 12:17:27.023718 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: nodename: dv-cinder-848900-3-iscsi Jul 14 12:17:27.023718 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: machine: x86_64 Jul 14 12:17:27.023718 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: clock source: unix Jul 14 12:17:27.023718 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: pcre jit disabled Jul 14 12:17:27.023718 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: detected number of CPU cores: 4 Jul 14 12:17:27.023718 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: current working directory: / Jul 14 12:17:27.023718 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: detected binary path: /usr/bin/uwsgi-core Jul 14 12:17:27.024459 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: your processes number limit is 47680 Jul 14 12:17:27.024459 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: your memory page size is 4096 bytes Jul 14 12:17:27.024459 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: detected max file descriptor number: 2048 Jul 14 12:17:27.024459 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: lock engine: pthread robust mutexes Jul 14 12:17:27.024459 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: thunder lock: enabled Jul 14 12:17:27.024459 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 12:17:27.024459 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 12:17:27.069032 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: Python main interpreter initialized at 0x5649142969c0 Jul 14 12:17:27.069032 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: python threads support enabled Jul 14 12:17:27.069032 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: your server socket listen backlog is limited to 100 connections Jul 14 12:17:27.069032 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: your mercy for graceful operations on workers is 90 seconds Jul 14 12:17:27.069482 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 12:17:27.069482 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: *** Operational MODE: preforking *** Jul 14 12:17:27.069744 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: *** uWSGI is running in multiple interpreter mode *** Jul 14 12:17:27.069744 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: spawned uWSGI master process (pid: 118248) Jul 14 12:17:27.069956 dv-cinder-848900-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 12:17:27.074789 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: spawned uWSGI worker 1 (pid: 118262, cores: 1) Jul 14 12:17:27.074789 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: spawned uWSGI worker 2 (pid: 118263, cores: 1) Jul 14 12:17:27.074789 dv-cinder-848900-3-iscsi devstack@n-api.service[118248]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 12:17:27.730418 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 12:17:27.733955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 12:17:28.928712 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:17:28.928712 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: from cryptography.utils import int_from_bytes Jul 14 12:17:28.929254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:17:28.929254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: from cryptography.utils import int_from_bytes Jul 14 12:17:28.929677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:17:28.929677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: from cryptography.utils import int_from_bytes Jul 14 12:17:28.929808 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:17:28.929808 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: from cryptography.utils import int_from_bytes Jul 14 12:17:31.231575 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 12:17:31.232140 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 12:17:31.232350 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 12:17:31.232789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 12:17:31.232981 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 12:17:31.233360 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 12:17:31.233453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 12:17:31.233647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.233744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 12:17:31.233978 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.234103 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 12:17:31.234305 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.234406 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 12:17:31.234628 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.234731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.234992 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.235121 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.235326 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.235431 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.235634 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.235742 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.235962 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.236115 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.236292 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.236425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.236554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.236647 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.236872 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.236980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.237199 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-3-iscsi {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.237299 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.237466 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.237568 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.237781 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.237881 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.238104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-848900-3-iscsi {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.238197 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.238421 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.238519 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.238720 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.238849 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.239054 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.239159 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.239367 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.239470 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.239668 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.239860 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.239967 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.240283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.240409 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.240618 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.240817 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.240984 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.241100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.241232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.241356 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.241557 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.241711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.241815 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.241981 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.242121 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.242297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.242412 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.242602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.242738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.242925 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.243091 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.243234 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.243491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-3-iscsi {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.243590 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.243811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.243909 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.244126 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.244226 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-848900-3-iscsi {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.244441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.244543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.244823 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.244933 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.245133 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.245236 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.245442 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.245544 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.245763 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.245876 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.246091 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.246210 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.246409 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.246532 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.246735 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.246881 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.247047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.247170 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.247369 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.247473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.247684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.247789 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.247999 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.248107 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.248829 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.249007 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.249159 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.249251 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.249443 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.249546 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.249750 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.249849 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.250063 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.250166 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.250313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.250411 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.250622 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.250724 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.250912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.251021 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.251219 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.251327 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.251539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.251678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.251833 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.252004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.252169 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.252270 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.252373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.252467 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.252695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.252796 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.253004 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.253103 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.253312 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.253405 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.253618 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.253709 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.253927 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.254034 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.254233 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.254325 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.254536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.254636 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.254863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.255027 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.255216 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.255372 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.255497 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.255644 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.255793 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.255948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.256095 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.256184 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.256410 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.256539 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.256726 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.256985 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.257136 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.257280 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.257422 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.257643 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.257843 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.257952 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.258049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.258181 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.258372 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.258515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.258695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.258851 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.259041 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.259158 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.259366 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.259464 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.259692 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.259796 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.260004 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.260104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.260313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.260413 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.260625 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.260733 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.260946 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.261119 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.261277 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.261368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.261587 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.261696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.261841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.261972 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.262148 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.262315 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.262453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.262556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.262805 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.262914 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.263102 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.263207 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.263409 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.263508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.263718 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.263841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.264072 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.264700 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.264888 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.264988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.265198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.265290 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.265531 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.265645 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.265842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.265944 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.266151 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.266255 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.266480 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.266573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.266822 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.266983 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.267161 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.267449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.267576 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.267786 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.267916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.268105 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.268277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.268437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.268638 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.268774 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.268992 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.269093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.269304 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.269417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.269698 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.269823 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.270052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.270155 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.270362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.270464 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.270684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.270806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.271019 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.271175 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.271333 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.271562 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.271682 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.271934 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.272089 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.272253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.272401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.272570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.272675 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.272871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.273003 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.273215 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.273347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.273550 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.273718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.273876 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.274085 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.274183 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.274464 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.274572 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.274801 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.274899 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.275120 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.275215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.275495 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.275737 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.275849 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.276112 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.276310 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.276449 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.276759 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.276865 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.277085 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.277186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.277396 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.277558 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.277708 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.277810 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.278018 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.278157 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.278389 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.278572 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.278734 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.278910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.279124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.279225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.279470 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.279594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.279851 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.279948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.280203 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.280322 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.280483 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:17:31.280596 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.280818 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.280922 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.281170 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.281314 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.281484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.281609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.281811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.281919 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.282127 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.282220 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.282441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.282551 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.282755 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.282885 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.283102 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.283223 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.283425 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.283534 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.283756 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.283866 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.284074 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.284182 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.284384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.284496 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.284699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.284798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.285007 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.285111 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.285325 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.285431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.285652 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.285749 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.285967 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.286063 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.286276 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.286381 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.286591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.286695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.286998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.287106 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.287372 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.287719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.287818 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.288080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.288177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.288645 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.288834 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.288949 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.289152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.289256 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.289468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.289609 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.289795 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.289898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.290119 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.290211 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.290432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.290540 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.291080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.291201 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.291402 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.291514 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.291729 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.291828 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.292068 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.292168 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.292384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.292489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.292702 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.292836 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.293016 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.293116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.293330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.293431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.293726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.293825 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.294059 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.294151 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.294962 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.295076 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.295177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.295276 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.295411 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.295578 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.295735 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.295899 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.295996 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.296095 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.296181 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.296264 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.296359 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.296444 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.296613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.296714 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.296932 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.297030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.297240 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.297384 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.297549 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.297858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.298169 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.298476 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.299046 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.299237 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.300151 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.300151 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.300480 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.300632 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.300842 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.301154 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.301464 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.301779 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.302091 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.302402 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.302726 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.303063 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.303371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.303697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.304003 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.304404 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.305047 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.305602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.305923 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.306307 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.306629 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.306846 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.306961 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.307206 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.307306 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.307569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.307668 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.307900 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.308018 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.308237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.308328 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.308571 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.308668 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.308880 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.308980 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.309230 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.309335 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.309537 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.309626 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.309854 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.309947 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.310161 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.310254 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.310472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.310570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.311322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.311440 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.311755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.311919 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.312077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.312197 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.312368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.312537 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.312677 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.312767 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.312987 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.313079 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.313294 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.313393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.313601 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.313700 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.313910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.313992 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.314236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.314336 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.314546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.314639 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.314880 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.314976 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.315187 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.315288 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.315493 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.315584 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.315838 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.315937 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.316148 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.316241 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.316491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.316581 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.316825 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.316922 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.317142 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.317233 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.317452 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.317548 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.317766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.317865 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.318080 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.318183 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.318389 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.318486 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.318699 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.318890 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.319038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.319127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.319347 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.319451 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.319658 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.319758 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.319966 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.320065 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.320277 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.320375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.320585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.320684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.320907 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.320997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.321216 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.321306 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.321525 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.321622 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.321828 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.321916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.322136 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.322225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.322492 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.322646 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.322830 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.323186 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.323514 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.323616 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.323849 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.323963 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.324190 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.324283 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.324496 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.324607 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.324820 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.324912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.325131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.325231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.325447 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.325556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.325834 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.325946 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.326066 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.326165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.326422 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.327182 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.327428 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.327529 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.327760 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.327875 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.328070 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.328237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.328399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.328505 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.328712 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.328818 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.329034 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.329200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.329342 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.329437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.329657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.329772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.329991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.330112 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.330325 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.330427 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.330635 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.330741 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.331024 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.331135 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.331485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.331598 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.331674 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.331744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.331977 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.332617 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.332617 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.332766 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.333269 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.333350 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.333432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.333505 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.333574 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.333651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.333722 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.333791 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.333875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.333955 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.334034 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.334105 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.334343 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.334453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.334662 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.334748 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.335081 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.335271 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.335398 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.335563 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.336682 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.336823 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.336947 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337141 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337228 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337309 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337387 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337459 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337528 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337597 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337690 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.337929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.338034 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.338197 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.338358 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.338511 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.338671 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.338846 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.339084 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.339190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.339396 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.339494 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.339708 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.339825 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.340121 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.340243 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.340365 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.340457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.340668 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.340759 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.340984 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.341084 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.341295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.341384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.341602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.341700 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.341917 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.342055 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.342261 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.342437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.342584 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.342924 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.343048 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.343239 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.343320 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.343549 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.343654 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.343857 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.343959 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.344166 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.344257 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.344474 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.344573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.344784 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.344890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.345108 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.345207 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.345415 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.345507 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.345725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.345823 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.346049 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.346205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.346330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.346431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.346639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.346748 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.346978 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.347083 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.347338 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.347558 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.347649 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.347896 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.347994 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.348214 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.348305 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.348533 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.348631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.348853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.348956 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.349173 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.349273 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.349484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.349587 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.349801 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.349947 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.350117 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.350331 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.350432 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.350530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.350737 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.350892 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.351068 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.351161 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.351375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.351467 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.351686 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.351778 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.351993 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.352093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.352297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.352396 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.352604 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.352705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.352914 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.353016 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.353219 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.353489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.353638 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.353831 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.353925 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.354156 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.354255 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.354484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.354582 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.354838 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.354956 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.355151 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.355266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.355456 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.355549 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.355777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.355878 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.356103 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.356235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.356372 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.356474 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.356679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.356780 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.356981 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.357152 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.357320 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.357413 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.357625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.358215 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.358483 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.358669 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.358822 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.359009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.359142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.359356 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.359497 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.359663 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.359762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.359969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.360097 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.360311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.360456 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.360599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.360700 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.360902 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.361002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.361207 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.361308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.361515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.361607 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.361842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.361933 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.362159 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.362262 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.362515 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.362851 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.363220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.363353 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.363475 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.363587 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.363802 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.364023 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.364142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.364374 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.364507 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.364709 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.364834 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.365047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.365165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.365381 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.366105 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.366105 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.366342 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.366454 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.366564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.366673 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.366673 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.366919 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.367031 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.367140 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.367261 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.367386 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.367548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.367681 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.367857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.367984 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.368174 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.368301 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.368541 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.368666 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.368796 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.368995 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.369095 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.369328 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.369434 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.369701 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.369790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.370010 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.370116 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.370327 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.370642 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.370822 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.370967 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.371103 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.371271 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.371405 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.371586 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.371726 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.371900 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.372033 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.372209 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.372342 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.372523 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.372655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.372830 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.372969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.373161 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.373415 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.374117 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.374441 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.374865 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.374865 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.375152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.375284 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.375420 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.375551 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.375679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.375820 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.375951 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.376088 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.376225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.376361 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.376593 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.376737 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.376905 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.377038 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.377218 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.377343 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.377532 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.377678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.377831 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.377962 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.378145 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.378277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.378458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.378602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.378858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.378996 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.379115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.379224 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.379386 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.379517 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.379778 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.379922 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.380060 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.380241 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.380383 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.380616 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.380758 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.380896 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.381025 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.381179 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.381319 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.381579 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.381723 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.381927 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.382069 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.382206 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.382347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.382477 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.382619 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.382756 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.383012 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.383161 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.383324 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.383457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.383633 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.383772 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.383952 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.384097 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.384278 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.384417 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.384601 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.384733 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.384920 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.385061 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.385239 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.385383 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.385548 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.385681 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.385883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.386013 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.386202 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.386400 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.386541 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.386852 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.387006 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.387144 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.387283 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.387419 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.387549 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.387749 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.387890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.388056 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.388186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.388401 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.388540 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.388691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.388832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.389038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.389252 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.389469 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.389667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.389808 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.389947 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.390076 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.390202 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.390337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.390465 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.390600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.390870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.391007 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.391143 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.391272 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.391408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.391550 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.391688 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.391818 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.391954 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.392115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.392247 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.392432 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.392572 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.392741 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.392871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.393055 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.393191 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.393371 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.393511 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.393686 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.393818 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.393997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.394129 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.394305 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.394437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.394616 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.394754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.394948 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.395092 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.395281 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.395412 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.395594 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.395727 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.395904 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.396045 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.396216 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.396348 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.396525 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.396656 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.396840 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.396985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.397151 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.397282 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.397488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.397631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.397798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.397944 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.398192 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.398333 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.398502 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.398633 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.398850 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.398993 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.399168 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.399297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.399476 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.399605 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.399783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.399916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.400137 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.400270 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.400408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.401197 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.401342 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.401457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.401565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.401673 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.401790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.401908 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.402028 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.402148 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.402266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.402385 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.402502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.402620 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.402620 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.402886 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.403015 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.403133 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.403252 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.403452 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.403574 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.403685 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.403822 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.403942 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.404130 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.404261 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.404455 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.404630 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.404912 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.405143 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.405376 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.405530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.405670 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.405806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.405936 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.406065 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.406202 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.406337 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.406515 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.406656 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.406865 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.407005 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.407193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.407310 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.407521 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.407638 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.407974 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.408109 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.408220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.408339 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.408461 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.408579 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.408756 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.408875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.409086 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.409220 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.409397 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.409564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.409896 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.410020 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.410210 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.410324 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.410532 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.410625 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.410887 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.411010 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.411196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.411291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.411512 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.411627 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.411854 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.411949 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.412166 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.412259 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.412479 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.412582 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.412808 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.412908 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.413117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.413208 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.413432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.413537 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.413747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.413847 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.414059 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.414159 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.414366 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.414467 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.414677 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.414816 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.415030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.415156 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.415337 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.415471 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.415664 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.416058 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.416251 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.416378 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.416577 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.416705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.416906 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.417072 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.417229 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.417372 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.417526 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.417675 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.417813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.417965 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.418113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.418249 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.418425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.418573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.418732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.418924 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.419098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.419206 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.419407 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.419500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.419731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.419845 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.420065 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.420716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.421009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.421350 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.421681 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.421912 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.422126 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.422337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.422523 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.422727 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.422973 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.423179 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.423179 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.423447 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.423578 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.423706 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.423843 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.423972 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.424120 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.424252 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.424387 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.424525 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.424660 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.424796 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.424957 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.425095 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.425233 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.425369 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.425534 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.425673 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.425841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.425972 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.426146 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.426278 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.426453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.426594 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.426873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.427018 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.427149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.427277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.427414 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.427553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.427682 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.427810 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.427973 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.428106 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.428281 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.428422 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.428591 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.428710 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.428918 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.429038 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.429223 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.429353 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.429546 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.429663 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.429861 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.429980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.430181 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.430317 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.430475 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.430602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.432156 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.432328 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.432328 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.432625 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.432625 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.433055 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.433055 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.433364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.433521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.433676 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.433828 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.433973 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.434126 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.434277 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.434429 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.434575 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.434718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.434898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.435044 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.435187 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.435342 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.435493 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.435637 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.435781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.436557 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.436789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.436789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.437242 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.437398 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.437543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.437688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.437848 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.437994 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.438145 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.438333 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.438479 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.438631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.438862 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.439016 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.439170 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.439170 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.439461 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.439604 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.439763 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.439916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.440062 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.440205 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.440453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.440619 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.440771 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.440927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.441185 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.441502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.441658 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.441899 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.442060 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.442060 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.442340 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.442484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.442639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.442810 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.442978 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.442978 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.443264 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.443264 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.443550 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.443697 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.443839 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.443839 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.444117 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.444273 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.444417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.444566 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.444715 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.444868 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.445020 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.445173 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.445323 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.445473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.445616 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.445761 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.445904 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.446054 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.446199 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.446348 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.446512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.446655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.446909 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.447061 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.447205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.447355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.447499 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.447640 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.447797 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.447940 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.448083 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.448226 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.448369 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.448520 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.448673 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.448816 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.448967 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.449117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.449267 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.449267 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.449548 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.449698 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.449841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.449983 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.450132 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.450295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.450456 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.450678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.450963 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.451112 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.451343 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.451739 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.452107 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.452339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.452502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.452656 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.452800 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.452953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.453116 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.453268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.453411 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.453411 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.453705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.453850 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.453992 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.454134 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.454277 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.454429 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.454583 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.454733 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.454931 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.455099 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.455245 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.455387 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.455538 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.455538 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.455810 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.455954 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.456096 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.456239 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.456394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.456545 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.456545 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.456826 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.456970 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.457159 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.457318 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.457470 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.457470 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.457741 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.457890 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.458117 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.458263 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.458413 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.458556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.458708 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.458897 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.459053 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.459198 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.459341 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.459491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.459635 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.459786 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.459939 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.460081 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.460231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.460373 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.460517 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.460687 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.460914 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.461070 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.461222 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.461388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.461624 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.461937 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.462170 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.462330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.462475 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.462619 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.462778 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.462941 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.463106 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.463251 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.463394 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.463544 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.463697 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.463840 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.463984 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.464133 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.464284 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.464434 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.464588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.464738 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.464882 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.466007 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.466169 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.466324 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.466480 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.466624 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.466798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.467734 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.467893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.468051 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.468208 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.468362 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.468507 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.468656 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.468811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.468955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.469114 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.469259 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.469404 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.469546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.469690 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.469845 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.469990 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.470132 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.470275 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.470426 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.470579 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.470740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.470925 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.471151 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.471306 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.471306 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.471615 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.471918 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.472168 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.472387 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.472387 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.472674 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.472819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.472981 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.473138 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.473288 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.473432 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.473576 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.473728 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.473871 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.473871 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.474150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.474292 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.474445 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.474598 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.474749 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.474928 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.475084 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.475235 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.475387 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.475544 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.475697 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.475847 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.475998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.476148 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.476304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.476447 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.476590 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.476734 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.476886 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.477029 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.477181 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.477325 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.477467 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.477609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.477753 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.477894 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.478049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.478200 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.478351 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.478496 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.478656 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.478834 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.478992 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.479143 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.479294 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.479452 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.479603 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.479756 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.479916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.480058 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.480208 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.480350 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.480500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.480662 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.480808 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.480949 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.481116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.481337 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.481500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.481702 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.482010 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.482182 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.482431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.482649 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.483472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.483721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.483962 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.484127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.484280 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.484432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.484585 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.484731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.484875 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.485019 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.485163 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.485305 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.485461 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.485618 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.485772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.485922 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.486074 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.486226 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.486378 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.486530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.486675 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.486837 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.487006 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.487161 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.487305 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.487456 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.487611 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.487754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.487897 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.488048 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.488200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.488343 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.488495 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.488638 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.488794 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.488937 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.489081 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.489081 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.489362 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.489513 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.489824 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.489824 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.490141 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.490395 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.490565 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.490732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.491484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.491651 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.491798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.491955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.492268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.492464 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.492770 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.492923 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.493068 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.493220 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.493475 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.493737 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.493896 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.494041 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.494184 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.494334 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.494481 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.494642 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.494816 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.494966 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.495111 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.495264 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.495409 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.495563 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.495707 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.495862 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.496007 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.496007 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.496299 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.496452 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.496606 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.496751 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.496751 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.497036 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.497203 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.497347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.497491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.497642 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.497793 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.497937 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.498092 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.498242 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.499066 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.499331 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.499532 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.499692 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.499847 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.499998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.500148 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.500292 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.500450 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.500607 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.500753 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.500907 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.501051 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.501201 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.501367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.501608 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.501769 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.501921 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.502066 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.502364 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.502520 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.502854 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.503018 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.503163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.503308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.503451 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.503607 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.503816 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.503966 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.504118 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.504270 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.504421 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.504576 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.504727 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.504916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.505079 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.505225 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.505374 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.505532 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.505686 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.505838 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.505991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.506135 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.506278 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.506434 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.506586 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.506738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.506738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.506738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.507187 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.507341 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.507501 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.507653 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.507796 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.507940 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.508097 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.508250 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.508400 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.508551 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.508695 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.508838 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.508990 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.509143 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.509286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.509443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.509587 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.509744 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.509889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.510041 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.510198 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.510342 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.510485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.510638 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.510823 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.510992 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.511140 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.511304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.511449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.511621 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.511866 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.512019 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.512175 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.512542 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.512700 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.512872 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.514000 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.514186 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.514434 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.514676 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.515001 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.515176 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.515332 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.515487 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.515633 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.515779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.515938 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.516097 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.516243 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.516388 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.516541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.516694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.516863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 12:17:31.517013 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:17:31.517013 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 12:17:31.663798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO dbcounter [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Registered counter for database nova_api Jul 14 12:17:31.672611 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO dbcounter [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Registered counter for database nova_api Jul 14 12:17:31.686819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_db.sqlalchemy.engines [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:17:31.693916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writer thread running {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:17:31.696558 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_db.sqlalchemy.engines [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:17:31.703212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writer thread running {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:17:31.754954 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.context [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e(cell1) {{(pid=118262) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 12:17:31.757095 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:17:31.758667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:17:31.759702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:17:31.760804 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.context [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e(cell1) {{(pid=118263) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 12:17:31.761676 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:17:31.763735 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO dbcounter [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Registered counter for database nova_cell0 Jul 14 12:17:31.765032 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:17:31.766673 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:17:31.767544 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:17:31.767841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO dbcounter [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Registered counter for database nova_cell1 Jul 14 12:17:31.769487 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:17:31.771478 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO dbcounter [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Registered counter for database nova_cell0 Jul 14 12:17:31.775096 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_db.sqlalchemy.engines [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:17:31.775610 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO dbcounter [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Registered counter for database nova_cell1 Jul 14 12:17:31.776914 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_db.sqlalchemy.engines [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:17:31.783212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_db.sqlalchemy.engines [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:17:31.783373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writer thread running {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:17:31.785706 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_db.sqlalchemy.engines [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:17:31.788769 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writer thread running {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:17:31.789561 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writer thread running {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:17:31.928271 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writer thread running {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:17:31.934801 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO dbcounter [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Registered counter for database nova_cell0 Jul 14 12:17:31.940168 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO dbcounter [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Registered counter for database nova_cell0 Jul 14 12:17:31.942072 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_db.sqlalchemy.engines [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:17:31.947328 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_db.sqlalchemy.engines [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:17:31.949876 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writer thread running {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:17:31.952557 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writer thread running {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:17:32.269565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: WARNING keystonemiddleware.auth_token [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 12:17:32.270265 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: WARNING keystonemiddleware.auth_token [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 12:17:32.276910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: WARNING keystonemiddleware.auth_token [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 12:17:32.277185 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: WARNING keystonemiddleware.auth_token [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 12:17:32.616100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: WARNING keystonemiddleware.auth_token [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 12:17:32.618607 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: WARNING keystonemiddleware.auth_token [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 12:17:32.621998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: WARNING keystonemiddleware.auth_token [None req-39a95cd7-23b3-42c2-bc72-10f95afe0997 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 12:17:32.625146 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: WARNING keystonemiddleware.auth_token [None req-36c3c457-d7ba-445d-91b7-23f84a16724a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 12:17:32.628802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649142969c0 pid: 118263 (default app) Jul 14 12:17:32.631374 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5649142969c0 pid: 118262 (default app) Jul 14 12:18:15.003543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=3 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:15.004390 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=3 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:15.005605 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=3 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:15.007335 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=3 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:16.308752 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:16.327764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:16.327764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:16.327764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:16.665112 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2c38680c-de57-4d3e-b61b-20316fa88191 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Action: 'create', calling method: .version_select at 0x7f0e285fdc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-348380641"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:17.960513 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-209f289c-c668-4e2a-a346-6f5bb61c0c3a tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] Action: 'create', calling method: .version_select at 0x7f0e285fcca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-823862138", "metadata": {"Type": "work"}}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:20.753939 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2c38680c-de57-4d3e-b61b-20316fa88191 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 5.774441 Jul 14 12:18:20.754932 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1154 bytes} [Thu Jul 14 12:18:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 5777 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 12:18:20.767811 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c11be2c6-d841-4199-9fc8-369677121c44 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284c6a60>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:20.811559 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-209f289c-c668-4e2a-a346-6f5bb61c0c3a tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.525029 Jul 14 12:18:20.812631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 1/2] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jul 14 12:18:16 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4528 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 14 12:18:20.845551 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cc7b943a-ac6b-4080-8729-63cca1b4d614 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] Calling method '.version_select at 0x7f0e284c7af0>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:21.038326 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c11be2c6-d841-4199-9fc8-369677121c44 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f" status: 200 len: 344 microversion: 2.1 time: 0.275475 Jul 14 12:18:21.039353 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 2/3] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:20 2022] GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f => generated 344 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:18:21.180760 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cc7b943a-ac6b-4080-8729-63cca1b4d614 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9" status: 200 len: 352 microversion: 2.1 time: 0.357248 Jul 14 12:18:21.181275 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 2/4] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:20 2022] GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9 => generated 352 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:22.051446 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-83245477-54b1-4b0d-a127-cab2ec800c28 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284c7c10>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:22.055722 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-dd89d59c-f28f-4736-a32f-97974dca288b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'create', calling method: .version_select at 0x7f0e284c6d30>, body: {"keypair": {"name": "tempest-keypair-252502396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6OzAoSBHq07l54LdQgfDYaD2hx9O96p5MwQOwJAPG5Ope7IwhHsD9KA5x5q97Xi5tEOweGYXD0aDTS+rFMznZI+yIPZUgKby6GGplZx+51Mh90DsMal61jJswlwTvZXQ=="}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:22.153504 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-dd89d59c-f28f-4736-a32f-97974dca288b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Getting quotas for project 33b09a1d039248aa95a089c8d8d99c68. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:18:22.188893 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-dd89d59c-f28f-4736-a32f-97974dca288b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Getting quotas for user d6da4b0616034aa1bb22c44a8f5ef280 and project 33b09a1d039248aa95a089c8d8d99c68. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:18:22.229803 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-83245477-54b1-4b0d-a127-cab2ec800c28 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f" status: 200 len: 345 microversion: 2.1 time: 0.182374 Jul 14 12:18:22.230489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 3/5] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:22 2022] GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f => generated 345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:18:22.236193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-63cddfbf-29b6-4728-af2a-8c2682eee4f0 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] Calling method '.version_select at 0x7f0e284e1310>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:22.362445 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-63cddfbf-29b6-4728-af2a-8c2682eee4f0 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9" status: 200 len: 353 microversion: 2.1 time: 0.130565 Jul 14 12:18:22.363269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 4/6] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:22 2022] GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9 => generated 353 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:22.377058 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6cb2181e-fd91-4770-9695-e1f4e6d4f80a tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Action: 'create', calling method: .version_select at 0x7f0e284e1940>, body: {"snapshot": {"volume_id": "3e203004-5590-4815-8688-9bef7f131c4f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-490223715"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:22.493605 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-dd89d59c-f28f-4736-a32f-97974dca288b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.734907 Jul 14 12:18:22.494616 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 3/7] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 12:18:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:22.501688 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-1e83d71a-ba45-4f8e-9d6f-da320d100d89 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] Calling method '.version_select at 0x7f0e284691f0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:22.596317 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-1e83d71a-ba45-4f8e-9d6f-da320d100d89 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9" status: 200 len: 353 microversion: 2.1 time: 0.099646 Jul 14 12:18:22.598116 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 4/8] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:22 2022] GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:22.614966 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-85f49762-5821-4b32-a5f4-29e5619b663d tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] Calling method '.version_select at 0x7f0e284a2f70>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:23.020613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-85f49762-5821-4b32-a5f4-29e5619b663d tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9" status: 202 len: 0 microversion: 2.1 time: 0.411729 Jul 14 12:18:23.022022 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 5/9] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:18:22 2022] DELETE /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9 => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:18:23.034098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d69a9dea-109c-4fe5-a96a-1044345626f0 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] Calling method '.version_select at 0x7f0e284690d0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:23.239868 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6cb2181e-fd91-4770-9695-e1f4e6d4f80a tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.873204 Jul 14 12:18:23.242700 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 5/10] 10.222.0.27 () {60 vars in 1161 bytes} [Thu Jul 14 12:18:22 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:23.254359 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9591508f-cb93-4e62-9389-55d22a2e7761 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284e1d30>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:23.365599 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9591508f-cb93-4e62-9389-55d22a2e7761 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1" status: 200 len: 286 microversion: 2.1 time: 0.115692 Jul 14 12:18:23.366273 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 6/11] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 12:18:23 2022] GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1 => generated 286 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:23.382938 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2463856c-a53b-47ef-b612-9ecddfa4fb6e tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284e1550>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:23.445483 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d69a9dea-109c-4fe5-a96a-1044345626f0 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9" status: 200 len: 352 microversion: 2.1 time: 0.417953 Jul 14 12:18:23.450135 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 6/12] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:23 2022] GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9 => generated 352 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:23.534929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2463856c-a53b-47ef-b612-9ecddfa4fb6e tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.162305 Jul 14 12:18:23.536003 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 7/13] 10.222.0.27 () {58 vars in 1139 bytes} [Thu Jul 14 12:18:23 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:18:23.550638 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f5d10127-c330-482d-ac75-33df785055a1 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e28469af0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:23.602229 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f5d10127-c330-482d-ac75-33df785055a1 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1" status: 200 len: 286 microversion: 2.1 time: 0.056788 Jul 14 12:18:23.603166 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 7/14] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 12:18:23 2022] GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1 => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:24.463841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2df9b232-26cb-4b8b-b313-b1c01508c036 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] Calling method '.version_select at 0x7f0e284eb0d0>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:24.515721 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-2df9b232-26cb-4b8b-b313-b1c01508c036 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] HTTP exception thrown: Volume 0b2a9406-a635-4ab3-822e-53b447f778a9 could not be found. Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2df9b232-26cb-4b8b-b313-b1c01508c036 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] Request method failure captured: Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9 HTTP/1.1 Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AmI1TNyrfcSDCv1qNBeaASmzhJQDPPT4owLLoqv8fa45bcuuoSRC5PTtRoV-_uRPvJLAoW6kJ31XQKs0XFb9m8zt8nmfLn15UNsDeB14zU79AMug3S7zqcV2J-g5S7qu3kp4OzqRYUkhCZCs3pUIKdGMLSgjOlkqnuV233lEftLQlI Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: e24bf8b5dd8247039f6a5ac09db96698 Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-VolumesGetTestJSON-2014511962 Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:18:24.521301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e24bf8b5dd8247039f6a5ac09db96698", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e24bf8b5dd8247039f6a5ac09db96698"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e24bf8b5dd8247039f6a5ac09db96698"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e24bf8b5dd8247039f6a5ac09db96698"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-VolumesGetTestJSON-2014511962 Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: e24bf8b5dd8247039f6a5ac09db96698 Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-VolumesGetTestJSON-2014511962 Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-VolumesGetTestJSON-2014511962-project Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 89f09a31bcaa4553b210a9222c3a794d Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-VolumesGetTestJSON-2014511962-project Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Volume 0b2a9406-a635-4ab3-822e-53b447f778a9 could not be found. Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '0b2a9406-a635-4ab3-822e-53b447f778a9'} Jul 14 12:18:24.522355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0b2a9406-a635-4ab3-822e-53b447f778a9 could not be found. (HTTP 404) (Request-ID: req-68097b48-ee2f-4f46-b52a-f56ebb15db93) Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:24.523028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 12:18:24.524104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0b2a9406-a635-4ab3-822e-53b447f778a9 could not be found. Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 12:18:24.524948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0b2a9406-a635-4ab3-822e-53b447f778a9 could not be found. Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0b2a9406-a635-4ab3-822e-53b447f778a9 could not be found. Jul 14 12:18:24.525821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:24.527816 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2df9b232-26cb-4b8b-b313-b1c01508c036 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] Returning 404 to user: Volume 0b2a9406-a635-4ab3-822e-53b447f778a9 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:24.529326 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2df9b232-26cb-4b8b-b313-b1c01508c036 tempest-VolumesGetTestJSON-2014511962 tempest-VolumesGetTestJSON-2014511962-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9" status: 404 len: 109 microversion: 2.1 time: 0.070949 Jul 14 12:18:24.530162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 8/15] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:24 2022] GET /compute/v2.1/os-volumes/0b2a9406-a635-4ab3-822e-53b447f778a9 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:18:24.623711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4c92a139-dcb4-42f9-a576-380e4f317b4a tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e28469d30>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:24.690527 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4c92a139-dcb4-42f9-a576-380e4f317b4a tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1" status: 200 len: 286 microversion: 2.1 time: 0.072139 Jul 14 12:18:24.691340 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 8/16] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 12:18:24 2022] GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:25.703891 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-53e86a34-b1f4-4e81-8bcb-10aebd8e15b2 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284eb040>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:25.775398 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-53e86a34-b1f4-4e81-8bcb-10aebd8e15b2 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1" status: 200 len: 286 microversion: 2.1 time: 0.073943 Jul 14 12:18:25.779857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 9/17] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 12:18:25 2022] GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:26.787289 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a6be6c8a-1da9-428d-b34d-0046656b4e8c tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284695e0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:26.921539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a6be6c8a-1da9-428d-b34d-0046656b4e8c tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1" status: 200 len: 286 microversion: 2.1 time: 0.138302 Jul 14 12:18:26.923177 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 9/18] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 12:18:26 2022] GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:27.938684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b9bb34e0-c530-4631-a156-61789b99b51b tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284ebb80>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:28.005356 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b9bb34e0-c530-4631-a156-61789b99b51b tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1" status: 200 len: 287 microversion: 2.1 time: 0.075200 Jul 14 12:18:28.006283 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 10/19] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 12:18:27 2022] GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:28.020590 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-04a3c742-a3c4-4273-971e-d0fd14721911 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284a28b0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:28.360195 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-04a3c742-a3c4-4273-971e-d0fd14721911 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1" status: 202 len: 0 microversion: 2.1 time: 0.346836 Jul 14 12:18:28.361221 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 10/20] 10.222.0.27 () {58 vars in 1253 bytes} [Thu Jul 14 12:18:28 2022] DELETE /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:18:28.373244 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e83957e1-1738-46c0-9975-b38b575551d7 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284c7f70>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:28.467579 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e83957e1-1738-46c0-9975-b38b575551d7 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1" status: 200 len: 286 microversion: 2.1 time: 0.101991 Jul 14 12:18:28.468513 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 11/21] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 12:18:28 2022] GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1 => generated 286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:29.480465 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8c4baf61-5c15-423f-8dcb-e6a05548cf92 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e27bfe1f0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:29.533515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-8c4baf61-5c15-423f-8dcb-e6a05548cf92 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] HTTP exception thrown: Snapshot e9386e6e-380c-4819-8fc0-3cd14c0ccda1 could not be found. Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8c4baf61-5c15-423f-8dcb-e6a05548cf92 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Request method failure captured: Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1 HTTP/1.1 Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmG8zk3No--jPOMO4sP3Y_2bF6sTC673nuDrGANeA9V0-4TJ2jqRBdfwsBftoeLBSMP7s9GvGG_ynVQsrBvrQUZoLFmnLab-mjCHgv9ChRWPyAha0gMYdQ5cPuyizmlMraqDF14CvZhgDGG34AZRdLxXsRgQX7RIMZCNe4ZZG9RdC4 Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: e8c82e1c7ee74798b03deba105d1cbf0 Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:18:29.538327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e8c82e1c7ee74798b03deba105d1cbf0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: e8c82e1c7ee74798b03deba105d1cbf0 Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-VolumesSnapshotsTestJSON-321298678-project Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 09f5c519c42f484b990b89ad5d3c93d5 Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321298678-project Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Snapshot e9386e6e-380c-4819-8fc0-3cd14c0ccda1 could not be found. Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'e9386e6e-380c-4819-8fc0-3cd14c0ccda1'} Jul 14 12:18:29.539841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e9386e6e-380c-4819-8fc0-3cd14c0ccda1 could not be found. (HTTP 404) (Request-ID: req-b5709c99-17a7-4f38-80e2-2a0d4784e2ea) Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:29.540553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 12:18:29.542062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e9386e6e-380c-4819-8fc0-3cd14c0ccda1 could not be found. Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 12:18:29.544291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e9386e6e-380c-4819-8fc0-3cd14c0ccda1 could not be found. Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e9386e6e-380c-4819-8fc0-3cd14c0ccda1 could not be found. Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8c4baf61-5c15-423f-8dcb-e6a05548cf92 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Returning 404 to user: Snapshot e9386e6e-380c-4819-8fc0-3cd14c0ccda1 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8c4baf61-5c15-423f-8dcb-e6a05548cf92 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1" status: 404 len: 111 microversion: 2.1 time: 0.063760 Jul 14 12:18:29.547408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 11/22] 10.222.0.27 () {58 vars in 1250 bytes} [Thu Jul 14 12:18:29 2022] GET /compute/v2.1/os-snapshots/e9386e6e-380c-4819-8fc0-3cd14c0ccda1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:18:29.550824 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a97897b7-4525-470c-8c58-82101361edf0 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284eb790>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:29.619668 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-471942618", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7a5d35d-c460-4290-bd4b-813214351817"}], "security_groups": [{"name": "tempest-securitygroup--690493634"}], "key_name": "tempest-keypair-252502396", "user_data": "}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:29.901440 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a97897b7-4525-470c-8c58-82101361edf0 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f" status: 202 len: 0 microversion: 2.1 time: 0.352872 Jul 14 12:18:29.902064 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 12/23] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:18:29 2022] DELETE /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:18:29.912250 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-db989989-91e8-4992-aaae-1dea41aafad0 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e284ebf70>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:30.031055 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] validate_networks() for [('d7a5d35d-c460-4290-bd4b-813214351817', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:18:30.080834 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-db989989-91e8-4992-aaae-1dea41aafad0 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f" status: 200 len: 344 microversion: 2.1 time: 0.173170 Jul 14 12:18:30.081618 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 13/24] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:29 2022] GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f => generated 344 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:31.577824 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1988580462", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:31.756584 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.network.neutron [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] validate_networks() for [('d58f87ee-c5c6-4211-9aab-58c9b00ee645', None, None, None, None, None)] {{(pid=118262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:18:31.997269 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:18:31.997814 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:18:31.998241 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:18:31.998894 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:18:31.999514 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:18:32.041603 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:32.042063 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:32.043206 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:32.043650 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:32.115075 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Getting quotas for project 33b09a1d039248aa95a089c8d8d99c68. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:18:32.134410 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Getting quotas for user d6da4b0616034aa1bb22c44a8f5ef280 and project 33b09a1d039248aa95a089c8d8d99c68. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:18:32.149887 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:18:32.154225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:18:32.373589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b044fdd3-de8e-424e-a6b6-a4e19241211f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.759819 Jul 14 12:18:32.376116 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 12/25] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:18:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 2761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:18:32.384672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4f188fc1-92cc-4467-8f55-6376e794bad9 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e27b02310>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:32.517074 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4f188fc1-92cc-4467-8f55-6376e794bad9 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f" status: 200 len: 344 microversion: 2.1 time: 0.140161 Jul 14 12:18:32.528336 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 13/26] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:32 2022] GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f => generated 344 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:32.893947 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-736669691", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "networks": [{"uuid": "516241b4-a8fc-4020-b297-f960f3e36672"}]}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:33.030759 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] validate_networks() for [('516241b4-a8fc-4020-b297-f960f3e36672', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:18:33.335235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Flavor limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:18:33.336429 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Image limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:18:33.337065 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Flavor pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:18:33.337631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Image pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:18:33.338195 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:18:33.359375 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:33.360060 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:33.361000 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:33.361574 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:33.404998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Getting quotas for project bb62d84584b3426687390833270648d6. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:18:33.421890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Getting quotas for user 0d302e57946c42d799e9bf120873eba6 and project bb62d84584b3426687390833270648d6. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:18:33.439784 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Going to run 1 instances... {{(pid=118262) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:18:33.443208 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:18:33.601941 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:18:33.602825 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:18:33.602974 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:18:33.603363 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:18:33.603684 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:18:33.613733 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:33.614355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:33.615235 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:33.615672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:33.618914 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-efe8286b-feb3-4cd1-9a0d-a8085141279c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.530980 Jul 14 12:18:33.619677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 14/27] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:18:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 2533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 12:18:33.629952 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a708367e-21f9-4cb4-ac1d-2a1ad20a4229 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:33.635162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a708367e-21f9-4cb4-ac1d-2a1ad20a4229 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:33.652385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Getting quotas for project 1500083e98d84701b246fbbd749354fa. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:18:33.663729 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Getting quotas for user a0a6364a4a884b09b5eb80897c19e296 and project 1500083e98d84701b246fbbd749354fa. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:18:33.691740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:18:33.694114 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:18:33.812256 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a708367e-21f9-4cb4-ac1d-2a1ad20a4229 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:33.854476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a708367e-21f9-4cb4-ac1d-2a1ad20a4229 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1236 microversion: 2.1 time: 0.229411 Jul 14 12:18:33.855178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 15/28] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:33 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1236 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:33.860671 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ce33644b-41c4-4b3d-8585-2e2bf759a7c9 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e284e1790>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:33.946162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ce33644b-41c4-4b3d-8585-2e2bf759a7c9 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/677d4aa8-fb7c-4e2a-8e2c-553cea8b8592" status: 200 len: 351 microversion: 2.1 time: 0.089439 Jul 14 12:18:33.948818 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 16/29] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:33 2022] GET /compute/v2.1/os-volumes/677d4aa8-fb7c-4e2a-8e2c-553cea8b8592 => generated 351 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:33.963238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6403814d-f689-4145-8705-201d32746f01 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e272f9d30>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:34.028762 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c798a656-117c-41c8-b882-795e0ffda25b tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.499224 Jul 14 12:18:34.030132 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 14/30] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:18:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1501 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:18:34.035634 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9afa53e7-0f9c-4319-83ae-3c5a68d43f12 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:34.036471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9afa53e7-0f9c-4319-83ae-3c5a68d43f12 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:34.146844 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9afa53e7-0f9c-4319-83ae-3c5a68d43f12 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:34.173775 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9afa53e7-0f9c-4319-83ae-3c5a68d43f12 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1222 microversion: 2.1 time: 0.141255 Jul 14 12:18:34.195594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 15/31] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:34 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1222 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:34.212379 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ed933337-df86-40ec-9e51-44cdcfc1c887 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:34.214059 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ed933337-df86-40ec-9e51-44cdcfc1c887 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:34.410667 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ed933337-df86-40ec-9e51-44cdcfc1c887 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:34.422735 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ed933337-df86-40ec-9e51-44cdcfc1c887 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1214 microversion: 2.1 time: 0.220232 Jul 14 12:18:34.422735 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 16/32] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:34 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:34.435766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-929570036", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:34.494990 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] validate_networks() for [('d58f87ee-c5c6-4211-9aab-58c9b00ee645', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:18:35.046191 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:18:35.046933 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:18:35.047143 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:18:35.047808 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:18:35.048570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:18:35.060588 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:35.062855 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:35.062855 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:35.062855 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:35.079300 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Getting quotas for project bb62d84584b3426687390833270648d6. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:18:35.083216 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Getting quotas for user 0d302e57946c42d799e9bf120873eba6 and project bb62d84584b3426687390833270648d6. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:18:35.094711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:18:35.097259 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:18:35.181646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-6403814d-f689-4145-8705-201d32746f01 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] HTTP exception thrown: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6403814d-f689-4145-8705-201d32746f01 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Request method failure captured: Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f HTTP/1.1 Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AmG8zk3No--jPOMO4sP3Y_2bF6sTC673nuDrGANeA9V0-4TJ2jqRBdfwsBftoeLBSMP7s9GvGG_ynVQsrBvrQUZoLFmnLab-mjCHgv9ChRWPyAha0gMYdQ5cPuyizmlMraqDF14CvZhgDGG34AZRdLxXsRgQX7RIMZCNe4ZZG9RdC4 Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: e8c82e1c7ee74798b03deba105d1cbf0 Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:18:35.183934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e8c82e1c7ee74798b03deba105d1cbf0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: e8c82e1c7ee74798b03deba105d1cbf0 Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-VolumesSnapshotsTestJSON-321298678-project Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 09f5c519c42f484b990b89ad5d3c93d5 Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321298678-project Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '3e203004-5590-4815-8688-9bef7f131c4f'} Jul 14 12:18:35.185103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. (HTTP 404) (Request-ID: req-5c77f4fe-0d42-4b09-8345-6bd7499acb92) Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:35.185913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 12:18:35.186951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 12:18:35.187934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6403814d-f689-4145-8705-201d32746f01 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Returning 404 to user: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6403814d-f689-4145-8705-201d32746f01 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f" status: 404 len: 109 microversion: 2.1 time: 1.228014 Jul 14 12:18:35.188935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 17/33] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:33 2022] GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f => generated 109 bytes in 1230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:18:35.210857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6e33126a-833e-4b18-b41d-d31ac49d09f6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:35.210857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6e33126a-833e-4b18-b41d-d31ac49d09f6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:35.282251 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6e33126a-833e-4b18-b41d-d31ac49d09f6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:35.290720 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6e33126a-833e-4b18-b41d-d31ac49d09f6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1236 microversion: 2.1 time: 0.093349 Jul 14 12:18:35.291796 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 18/34] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:35 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:35.297515 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-39e193ee-bb1a-4aa0-a6a9-159a9456c836 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e27300550>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:35.327073 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b69d1bb8-a2bf-4958-b1c0-29d46c29fa7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.902717 Jul 14 12:18:35.327073 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 17/35] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:18:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:18:35.340326 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-10bd8510-6bf1-4ddd-be9b-440dc7aca5f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:35.340326 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-10bd8510-6bf1-4ddd-be9b-440dc7aca5f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:35.511128 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-39e193ee-bb1a-4aa0-a6a9-159a9456c836 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] HTTP exception thrown: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-39e193ee-bb1a-4aa0-a6a9-159a9456c836 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Request method failure captured: Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: DELETE /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f HTTP/1.1 Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AmG8zk3No--jPOMO4sP3Y_2bF6sTC673nuDrGANeA9V0-4TJ2jqRBdfwsBftoeLBSMP7s9GvGG_ynVQsrBvrQUZoLFmnLab-mjCHgv9ChRWPyAha0gMYdQ5cPuyizmlMraqDF14CvZhgDGG34AZRdLxXsRgQX7RIMZCNe4ZZG9RdC4 Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: e8c82e1c7ee74798b03deba105d1cbf0 Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:18:35.513393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e8c82e1c7ee74798b03deba105d1cbf0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: e8c82e1c7ee74798b03deba105d1cbf0 Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-VolumesSnapshotsTestJSON-321298678-project Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 09f5c519c42f484b990b89ad5d3c93d5 Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321298678-project Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '3e203004-5590-4815-8688-9bef7f131c4f'} Jul 14 12:18:35.514573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. (HTTP 404) (Request-ID: req-d56aacf3-3d8c-4b16-b8ff-def82a8e1f26) Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:35.515313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 12:18:35.516258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 12:18:35.517198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-39e193ee-bb1a-4aa0-a6a9-159a9456c836 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Returning 404 to user: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-39e193ee-bb1a-4aa0-a6a9-159a9456c836 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f" status: 404 len: 109 microversion: 2.1 time: 0.221594 Jul 14 12:18:35.518290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 19/36] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:18:35 2022] DELETE /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f => generated 109 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:18:35.520393 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-10bd8510-6bf1-4ddd-be9b-440dc7aca5f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:35.526634 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-7e2f8de6-207f-4b6f-8eef-22fa12e3b1b2 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:35.533731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-10bd8510-6bf1-4ddd-be9b-440dc7aca5f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1221 microversion: 2.1 time: 0.201603 Jul 14 12:18:35.534317 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 18/37] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:35 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1221 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:35.546830 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-7e2f8de6-207f-4b6f-8eef-22fa12e3b1b2 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:35.560666 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4cc559ea-a8e9-40c1-8a2e-df95ac2cd8c4 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Calling method '.version_select at 0x7f0e27b0c9d0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:35.642646 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-4cc559ea-a8e9-40c1-8a2e-df95ac2cd8c4 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] HTTP exception thrown: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4cc559ea-a8e9-40c1-8a2e-df95ac2cd8c4 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Request method failure captured: Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f HTTP/1.1 Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmG8zk3No--jPOMO4sP3Y_2bF6sTC673nuDrGANeA9V0-4TJ2jqRBdfwsBftoeLBSMP7s9GvGG_ynVQsrBvrQUZoLFmnLab-mjCHgv9ChRWPyAha0gMYdQ5cPuyizmlMraqDF14CvZhgDGG34AZRdLxXsRgQX7RIMZCNe4ZZG9RdC4 Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: e8c82e1c7ee74798b03deba105d1cbf0 Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:18:35.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_e8c82e1c7ee74798b03deba105d1cbf0", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/e8c82e1c7ee74798b03deba105d1cbf0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: e8c82e1c7ee74798b03deba105d1cbf0 Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-321298678 Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-VolumesSnapshotsTestJSON-321298678-project Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 09f5c519c42f484b990b89ad5d3c93d5 Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-VolumesSnapshotsTestJSON-321298678-project Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '3e203004-5590-4815-8688-9bef7f131c4f'} Jul 14 12:18:35.646553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. (HTTP 404) (Request-ID: req-c7d47582-5374-4811-b0d1-4820703378ea) Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:35.647573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 12:18:35.648473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 12:18:35.649385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4cc559ea-a8e9-40c1-8a2e-df95ac2cd8c4 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] Returning 404 to user: Volume 3e203004-5590-4815-8688-9bef7f131c4f could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4cc559ea-a8e9-40c1-8a2e-df95ac2cd8c4 tempest-VolumesSnapshotsTestJSON-321298678 tempest-VolumesSnapshotsTestJSON-321298678-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f" status: 404 len: 109 microversion: 2.1 time: 0.100935 Jul 14 12:18:35.650397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 19/38] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:35 2022] GET /compute/v2.1/os-volumes/3e203004-5590-4815-8688-9bef7f131c4f => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:18:35.669780 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-7e2f8de6-207f-4b6f-8eef-22fa12e3b1b2 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:35.678468 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-7e2f8de6-207f-4b6f-8eef-22fa12e3b1b2 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1214 microversion: 2.1 time: 0.160422 Jul 14 12:18:35.680310 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 20/39] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:35 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:36.311518 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9f2a16ab-0ca1-4e24-b51e-316d257b3c75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:36.312337 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9f2a16ab-0ca1-4e24-b51e-316d257b3c75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:36.321590 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f2a16ab-0ca1-4e24-b51e-316d257b3c75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:36.322627 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f2a16ab-0ca1-4e24-b51e-316d257b3c75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:36.325972 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f2a16ab-0ca1-4e24-b51e-316d257b3c75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:36.326579 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f2a16ab-0ca1-4e24-b51e-316d257b3c75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:36.554149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-86475d77-106d-4a27-b765-5890848eefc2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:36.555647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-86475d77-106d-4a27-b765-5890848eefc2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:36.576607 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9f2a16ab-0ca1-4e24-b51e-316d257b3c75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:36.600294 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9f2a16ab-0ca1-4e24-b51e-316d257b3c75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1240 microversion: 2.1 time: 0.286095 Jul 14 12:18:36.600294 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 20/40] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:36 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1240 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:36.600294 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bf130926-a7a7-4c5a-840c-f37494c8644c tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e26aae820>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:36.676554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bf130926-a7a7-4c5a-840c-f37494c8644c tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/c2822a8e-4ada-49a0-af75-494c479bb7a3" status: 200 len: 351 microversion: 2.1 time: 0.081723 Jul 14 12:18:36.677121 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 21/41] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:36 2022] GET /compute/v2.1/os-volumes/c2822a8e-4ada-49a0-af75-494c479bb7a3 => generated 351 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:36.698795 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8323b9ea-f079-464b-aab3-9d6c06296124 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:36.699468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8323b9ea-f079-464b-aab3-9d6c06296124 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:36.729365 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8323b9ea-f079-464b-aab3-9d6c06296124 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:36.731045 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8323b9ea-f079-464b-aab3-9d6c06296124 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:36.737354 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8323b9ea-f079-464b-aab3-9d6c06296124 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:36.738455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8323b9ea-f079-464b-aab3-9d6c06296124 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:36.838742 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8323b9ea-f079-464b-aab3-9d6c06296124 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:36.846568 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8323b9ea-f079-464b-aab3-9d6c06296124 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1210 microversion: 2.1 time: 0.154537 Jul 14 12:18:36.847283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 22/42] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:36 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1210 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:37.003318 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-86475d77-106d-4a27-b765-5890848eefc2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:37.014306 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-86475d77-106d-4a27-b765-5890848eefc2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1221 microversion: 2.1 time: 0.463786 Jul 14 12:18:37.015421 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 21/43] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:36 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1221 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:37.616803 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-aa07abc8-36fb-44fd-b679-98b6fc9118f4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:37.617658 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-aa07abc8-36fb-44fd-b679-98b6fc9118f4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:37.628825 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aa07abc8-36fb-44fd-b679-98b6fc9118f4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:37.630450 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aa07abc8-36fb-44fd-b679-98b6fc9118f4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:37.631315 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aa07abc8-36fb-44fd-b679-98b6fc9118f4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:37.632721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aa07abc8-36fb-44fd-b679-98b6fc9118f4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:37.790590 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-aa07abc8-36fb-44fd-b679-98b6fc9118f4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:37.803622 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-aa07abc8-36fb-44fd-b679-98b6fc9118f4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1288 microversion: 2.1 time: 0.190954 Jul 14 12:18:37.817662 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 23/44] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:37 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1288 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:37.865510 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2a5e2b90-1c7f-486b-9617-41ca428b0e7e tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:37.866832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2a5e2b90-1c7f-486b-9617-41ca428b0e7e tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:37.877994 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2a5e2b90-1c7f-486b-9617-41ca428b0e7e tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:37.878799 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2a5e2b90-1c7f-486b-9617-41ca428b0e7e tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:37.879743 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2a5e2b90-1c7f-486b-9617-41ca428b0e7e tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:37.883050 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2a5e2b90-1c7f-486b-9617-41ca428b0e7e tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:38.032607 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d44f9f28-c6ae-48f8-bbbe-868bb4416e87 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:38.033554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d44f9f28-c6ae-48f8-bbbe-868bb4416e87 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:38.040190 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d44f9f28-c6ae-48f8-bbbe-868bb4416e87 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:38.040645 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d44f9f28-c6ae-48f8-bbbe-868bb4416e87 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:38.041550 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d44f9f28-c6ae-48f8-bbbe-868bb4416e87 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:38.041990 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d44f9f28-c6ae-48f8-bbbe-868bb4416e87 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:38.082290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2a5e2b90-1c7f-486b-9617-41ca428b0e7e tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:38.094424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2a5e2b90-1c7f-486b-9617-41ca428b0e7e tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1266 microversion: 2.1 time: 0.233343 Jul 14 12:18:38.095223 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 22/45] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:37 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1266 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:38.141375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d44f9f28-c6ae-48f8-bbbe-868bb4416e87 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:38.151009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d44f9f28-c6ae-48f8-bbbe-868bb4416e87 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1217 microversion: 2.1 time: 0.122838 Jul 14 12:18:38.152317 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 24/46] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:38 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1217 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:18:38.653594 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b289f02a-c15c-4ac5-a58d-1f89ad27f9fc tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e2729f5e0>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:38.759848 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b289f02a-c15c-4ac5-a58d-1f89ad27f9fc tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/ca2a9bc0-66cd-428e-8ac9-2a5793e6f341" status: 200 len: 350 microversion: 2.1 time: 0.116727 Jul 14 12:18:38.761172 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 23/47] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:38 2022] GET /compute/v2.1/os-volumes/ca2a9bc0-66cd-428e-8ac9-2a5793e6f341 => generated 350 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:38.774353 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-14b92ccc-7168-4381-a1a6-a8d566cba308 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e26a411f0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:38.832106 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-dab3d6d3-620f-48fc-af8a-4ceaa02322e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:38.833269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-dab3d6d3-620f-48fc-af8a-4ceaa02322e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:38.859986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dab3d6d3-620f-48fc-af8a-4ceaa02322e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:38.864000 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dab3d6d3-620f-48fc-af8a-4ceaa02322e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:38.865049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dab3d6d3-620f-48fc-af8a-4ceaa02322e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:38.874716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dab3d6d3-620f-48fc-af8a-4ceaa02322e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:38.973988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-14b92ccc-7168-4381-a1a6-a8d566cba308 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.205225 Jul 14 12:18:38.975042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 25/48] 10.222.0.27 () {58 vars in 1133 bytes} [Thu Jul 14 12:18:38 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:38.987686 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-6b6c671f-25b2-42a0-b458-0b62bfdf54da tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e26a53040>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:39.072743 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dab3d6d3-620f-48fc-af8a-4ceaa02322e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:39.095744 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-dab3d6d3-620f-48fc-af8a-4ceaa02322e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1296 microversion: 2.1 time: 0.275013 Jul 14 12:18:39.098207 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 24/49] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:38 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1296 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:18:39.114230 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3b33a74e-67eb-41ca-8166-d28c327819ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:39.115681 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3b33a74e-67eb-41ca-8166-d28c327819ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:39.133748 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3b33a74e-67eb-41ca-8166-d28c327819ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:39.134139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3b33a74e-67eb-41ca-8166-d28c327819ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:39.135731 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3b33a74e-67eb-41ca-8166-d28c327819ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:39.136220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3b33a74e-67eb-41ca-8166-d28c327819ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:39.173000 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-6b6c671f-25b2-42a0-b458-0b62bfdf54da tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.189624 Jul 14 12:18:39.173594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 26/50] 10.222.0.27 () {58 vars in 1148 bytes} [Thu Jul 14 12:18:38 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:18:39.179297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-48894934-14e5-41ed-9a0c-c52156ac0b02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:39.180267 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-48894934-14e5-41ed-9a0c-c52156ac0b02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:39.202501 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-48894934-14e5-41ed-9a0c-c52156ac0b02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:39.203276 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-48894934-14e5-41ed-9a0c-c52156ac0b02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:39.206421 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-48894934-14e5-41ed-9a0c-c52156ac0b02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:39.210260 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-48894934-14e5-41ed-9a0c-c52156ac0b02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:39.275926 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3b33a74e-67eb-41ca-8166-d28c327819ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:39.286187 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3b33a74e-67eb-41ca-8166-d28c327819ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1284 microversion: 2.1 time: 0.177213 Jul 14 12:18:39.303608 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 25/51] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:39 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1284 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:39.314514 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ef61799c-b991-48a1-91fa-e1d1cb4142f6 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e2723e700>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:39.464228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ef61799c-b991-48a1-91fa-e1d1cb4142f6 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.159254 Jul 14 12:18:39.465313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 26/52] 10.222.0.27 () {58 vars in 1133 bytes} [Thu Jul 14 12:18:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:39.486642 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6425921b-f44f-49f8-92ca-bccae8fc265e tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e2729fca0>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:39.664980 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6425921b-f44f-49f8-92ca-bccae8fc265e tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.182169 Jul 14 12:18:39.665827 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 27/53] 10.222.0.27 () {58 vars in 1166 bytes} [Thu Jul 14 12:18:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:18:39.686261 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b34d5720-d0eb-4d88-8aa9-ca864d7de5e2 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e272f9a60>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:39.883515 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b34d5720-d0eb-4d88-8aa9-ca864d7de5e2 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.209430 Jul 14 12:18:39.892576 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 28/54] 10.222.0.27 () {58 vars in 1169 bytes} [Thu Jul 14 12:18:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:39.903772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-88582fe7-112b-4c8d-8172-5b8795d4b6a8 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e2724b550>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:39.941670 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-48894934-14e5-41ed-9a0c-c52156ac0b02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:39.961237 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-48894934-14e5-41ed-9a0c-c52156ac0b02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1273 microversion: 2.1 time: 0.784273 Jul 14 12:18:39.963680 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 27/55] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:39 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1273 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:40.088279 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-88582fe7-112b-4c8d-8172-5b8795d4b6a8 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.188530 Jul 14 12:18:40.089695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 29/56] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jul 14 12:18:39 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:18:40.112583 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-726e493b-05d6-438f-8322-2e1b28d97188 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e26a15700>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:40.114757 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5aff8b38-fb88-45a2-afb5-255caa23bbfa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:40.115519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5aff8b38-fb88-45a2-afb5-255caa23bbfa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:40.127049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5aff8b38-fb88-45a2-afb5-255caa23bbfa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:40.127615 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5aff8b38-fb88-45a2-afb5-255caa23bbfa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:40.128693 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5aff8b38-fb88-45a2-afb5-255caa23bbfa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:40.129632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5aff8b38-fb88-45a2-afb5-255caa23bbfa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:40.300938 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-726e493b-05d6-438f-8322-2e1b28d97188 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.202050 Jul 14 12:18:40.302703 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 28/57] 10.222.0.27 () {58 vars in 1187 bytes} [Thu Jul 14 12:18:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:40.318355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-60d0df10-e396-4bbd-93fd-68bdf3f5d162 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:40.319615 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-60d0df10-e396-4bbd-93fd-68bdf3f5d162 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:40.333182 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-60d0df10-e396-4bbd-93fd-68bdf3f5d162 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:40.334165 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-60d0df10-e396-4bbd-93fd-68bdf3f5d162 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:40.335409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-60d0df10-e396-4bbd-93fd-68bdf3f5d162 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:40.336709 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-60d0df10-e396-4bbd-93fd-68bdf3f5d162 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:40.355717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5aff8b38-fb88-45a2-afb5-255caa23bbfa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:40.365777 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5aff8b38-fb88-45a2-afb5-255caa23bbfa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1294 microversion: 2.1 time: 0.256120 Jul 14 12:18:40.378122 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 30/58] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:40 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1294 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:40.390481 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9ffd1c9a-d6f5-4f20-b9f6-95a630fdc0b6 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] Calling method '.version_select at 0x7f0e2724b820>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:40.515950 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-60d0df10-e396-4bbd-93fd-68bdf3f5d162 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:40.532901 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-60d0df10-e396-4bbd-93fd-68bdf3f5d162 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1272 microversion: 2.1 time: 0.224482 Jul 14 12:18:40.533948 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 29/59] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:40 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1272 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:18:40.705107 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9ffd1c9a-d6f5-4f20-b9f6-95a630fdc0b6 tempest-VolumesTestJSON-1920286653 tempest-VolumesTestJSON-1920286653-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.266350 Jul 14 12:18:40.705107 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 31/60] 10.222.0.27 () {58 vars in 1154 bytes} [Thu Jul 14 12:18:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:40.981712 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a398dbad-0b5f-4c96-be7f-e18121a23869 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:40.982365 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a398dbad-0b5f-4c96-be7f-e18121a23869 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:41.006756 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a398dbad-0b5f-4c96-be7f-e18121a23869 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:41.007279 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a398dbad-0b5f-4c96-be7f-e18121a23869 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:41.013672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a398dbad-0b5f-4c96-be7f-e18121a23869 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:41.014453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a398dbad-0b5f-4c96-be7f-e18121a23869 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:41.139475 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a398dbad-0b5f-4c96-be7f-e18121a23869 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:41.152320 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a398dbad-0b5f-4c96-be7f-e18121a23869 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1279 microversion: 2.1 time: 0.175619 Jul 14 12:18:41.165813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 30/61] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:40 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:41.386739 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1ca525f2-a50a-41fe-bf5f-7f97e0c2ac3f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:41.388075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1ca525f2-a50a-41fe-bf5f-7f97e0c2ac3f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:41.417067 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1ca525f2-a50a-41fe-bf5f-7f97e0c2ac3f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:41.417844 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1ca525f2-a50a-41fe-bf5f-7f97e0c2ac3f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:41.422780 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1ca525f2-a50a-41fe-bf5f-7f97e0c2ac3f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:41.423246 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1ca525f2-a50a-41fe-bf5f-7f97e0c2ac3f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:41.550783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-25c69d95-7647-4551-b592-e62724b70ae6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:41.551419 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-25c69d95-7647-4551-b592-e62724b70ae6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:41.563840 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25c69d95-7647-4551-b592-e62724b70ae6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:41.564907 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25c69d95-7647-4551-b592-e62724b70ae6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:41.565726 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25c69d95-7647-4551-b592-e62724b70ae6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:41.566157 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25c69d95-7647-4551-b592-e62724b70ae6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:42.187528 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-25c69d95-7647-4551-b592-e62724b70ae6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:42.207424 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-25c69d95-7647-4551-b592-e62724b70ae6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.655925 Jul 14 12:18:42.212797 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 31/62] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:41 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:42.249748 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8d59d9e8-7414-4264-b252-eb4e237b923c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:42.250458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8d59d9e8-7414-4264-b252-eb4e237b923c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:42.273387 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d59d9e8-7414-4264-b252-eb4e237b923c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:42.298225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d59d9e8-7414-4264-b252-eb4e237b923c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:42.306807 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d59d9e8-7414-4264-b252-eb4e237b923c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:42.306807 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d59d9e8-7414-4264-b252-eb4e237b923c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:42.442514 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8d59d9e8-7414-4264-b252-eb4e237b923c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:42.451807 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8d59d9e8-7414-4264-b252-eb4e237b923c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1279 microversion: 2.1 time: 0.237486 Jul 14 12:18:42.452472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 32/63] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:42 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1279 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:42.648508 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1ca525f2-a50a-41fe-bf5f-7f97e0c2ac3f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:42.664153 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1ca525f2-a50a-41fe-bf5f-7f97e0c2ac3f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 1.281297 Jul 14 12:18:42.666542 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 32/64] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:41 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:43.237284 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b40bceac-0dff-48ba-987c-1aee206ecb33 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:43.238370 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b40bceac-0dff-48ba-987c-1aee206ecb33 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:43.245969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b40bceac-0dff-48ba-987c-1aee206ecb33 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:43.246425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b40bceac-0dff-48ba-987c-1aee206ecb33 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:43.247295 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b40bceac-0dff-48ba-987c-1aee206ecb33 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:43.247831 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b40bceac-0dff-48ba-987c-1aee206ecb33 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:43.470291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d6700c2f-f753-4119-be1a-50b12584adec tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:43.470971 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d6700c2f-f753-4119-be1a-50b12584adec tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:43.473317 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:43.493392 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d6700c2f-f753-4119-be1a-50b12584adec tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:43.501686 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d6700c2f-f753-4119-be1a-50b12584adec tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:43.509099 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d6700c2f-f753-4119-be1a-50b12584adec tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:43.509587 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d6700c2f-f753-4119-be1a-50b12584adec tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:44.086996 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d6700c2f-f753-4119-be1a-50b12584adec tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:44.105258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d6700c2f-f753-4119-be1a-50b12584adec tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.638231 Jul 14 12:18:44.115982 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 33/65] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:43 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:44.129494 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fc9a5345-16ea-4784-9e3a-2a72a0780f0b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:44.131181 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fc9a5345-16ea-4784-9e3a-2a72a0780f0b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:44.146571 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc9a5345-16ea-4784-9e3a-2a72a0780f0b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:44.147905 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc9a5345-16ea-4784-9e3a-2a72a0780f0b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:44.150287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc9a5345-16ea-4784-9e3a-2a72a0780f0b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:44.151041 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc9a5345-16ea-4784-9e3a-2a72a0780f0b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:44.396203 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b40bceac-0dff-48ba-987c-1aee206ecb33 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:44.404639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b40bceac-0dff-48ba-987c-1aee206ecb33 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 1.175364 Jul 14 12:18:44.408561 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 33/66] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:43 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:44.567440 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-fc9a5345-16ea-4784-9e3a-2a72a0780f0b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:44.578359 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fc9a5345-16ea-4784-9e3a-2a72a0780f0b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.466197 Jul 14 12:18:44.591175 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 34/67] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:44 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:45.125192 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-42817106-2b04-44a9-b88b-4380243d7e38 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:45.126129 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-42817106-2b04-44a9-b88b-4380243d7e38 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:45.138358 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=6 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:45.149998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42817106-2b04-44a9-b88b-4380243d7e38 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:45.150468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42817106-2b04-44a9-b88b-4380243d7e38 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:45.152374 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42817106-2b04-44a9-b88b-4380243d7e38 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:45.155159 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42817106-2b04-44a9-b88b-4380243d7e38 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:45.442070 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-d6f8b491-7aef-4028-93fd-15866695b55b req-15c53338-0161-4ef8-b209-09d665ac1dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc2b616c-dc02-4d81-9eb1-028c8077a4fe", "tag": "cd1e3c51-3b14-4f81-94e0-3273cc7ab2dd"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:45.463865 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-d6f8b491-7aef-4028-93fd-15866695b55b req-15c53338-0161-4ef8-b209-09d665ac1dc4 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:45.464563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-d6f8b491-7aef-4028-93fd-15866695b55b req-15c53338-0161-4ef8-b209-09d665ac1dc4 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:45.475260 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-42817106-2b04-44a9-b88b-4380243d7e38 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:45.484408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-42817106-2b04-44a9-b88b-4380243d7e38 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.364592 Jul 14 12:18:45.494517 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 34/68] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:45 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:45.497248 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3ad83a29-a7d1-4fea-aebb-c0f5248a5850 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:45.498644 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3ad83a29-a7d1-4fea-aebb-c0f5248a5850 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:45.513582 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=10 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:45.519051 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3ad83a29-a7d1-4fea-aebb-c0f5248a5850 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:45.519495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3ad83a29-a7d1-4fea-aebb-c0f5248a5850 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:45.521251 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3ad83a29-a7d1-4fea-aebb-c0f5248a5850 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:45.521699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3ad83a29-a7d1-4fea-aebb-c0f5248a5850 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:45.522612 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-d6f8b491-7aef-4028-93fd-15866695b55b req-15c53338-0161-4ef8-b209-09d665ac1dc4 service nova] Creating event network-changed:cd1e3c51-3b14-4f81-94e0-3273cc7ab2dd for instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe on hv-cinder-84890 Jul 14 12:18:45.523476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-d6f8b491-7aef-4028-93fd-15866695b55b req-15c53338-0161-4ef8-b209-09d665ac1dc4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118262) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 12:18:45.529094 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-29e6f7c3-1138-4564-b6dd-b1a880f21d4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:45.529094 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-29e6f7c3-1138-4564-b6dd-b1a880f21d4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:45.529094 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-29e6f7c3-1138-4564-b6dd-b1a880f21d4b None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:45.529094 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-29e6f7c3-1138-4564-b6dd-b1a880f21d4b None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:45.539665 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=28 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:45.571729 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.compute.rpcapi [None req-29e6f7c3-1138-4564-b6dd-b1a880f21d4b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 12:18:45.572836 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-29e6f7c3-1138-4564-b6dd-b1a880f21d4b None None] Releasing lock "compute-rpcapi-router" {{(pid=118262) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 12:18:45.610939 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-29e6f7c3-1138-4564-b6dd-b1a880f21d4b None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.310173 Jul 14 12:18:45.612553 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 35/69] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:18:45.634378 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9f7ce95c-e6d2-42db-80a3-5d3f6ebd7da0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:45.635182 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-9f7ce95c-e6d2-42db-80a3-5d3f6ebd7da0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:45.644008 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f7ce95c-e6d2-42db-80a3-5d3f6ebd7da0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:45.644726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f7ce95c-e6d2-42db-80a3-5d3f6ebd7da0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:45.645647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f7ce95c-e6d2-42db-80a3-5d3f6ebd7da0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:45.646194 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f7ce95c-e6d2-42db-80a3-5d3f6ebd7da0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:46.008963 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9f7ce95c-e6d2-42db-80a3-5d3f6ebd7da0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:46.018076 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9f7ce95c-e6d2-42db-80a3-5d3f6ebd7da0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.404044 Jul 14 12:18:46.028874 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 36/70] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:45 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:46.054243 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3ad83a29-a7d1-4fea-aebb-c0f5248a5850 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:46.063477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3ad83a29-a7d1-4fea-aebb-c0f5248a5850 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.576639 Jul 14 12:18:46.064122 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 35/71] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:45 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:46.502566 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0a014159-ac44-4927-b613-abee9457c59f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:46.503850 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0a014159-ac44-4927-b613-abee9457c59f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:46.512229 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a014159-ac44-4927-b613-abee9457c59f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:46.527072 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a014159-ac44-4927-b613-abee9457c59f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:46.527072 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a014159-ac44-4927-b613-abee9457c59f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:46.527072 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a014159-ac44-4927-b613-abee9457c59f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:46.723966 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0a014159-ac44-4927-b613-abee9457c59f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:46.745419 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0a014159-ac44-4927-b613-abee9457c59f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.247114 Jul 14 12:18:46.746341 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 37/72] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:46 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:47.040223 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4b58b50e-f6dd-45dc-b4f0-9e4c9eb848f5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:47.040727 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4b58b50e-f6dd-45dc-b4f0-9e4c9eb848f5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:47.058562 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4b58b50e-f6dd-45dc-b4f0-9e4c9eb848f5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:47.059748 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4b58b50e-f6dd-45dc-b4f0-9e4c9eb848f5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:47.060855 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4b58b50e-f6dd-45dc-b4f0-9e4c9eb848f5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:47.062263 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4b58b50e-f6dd-45dc-b4f0-9e4c9eb848f5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:47.080643 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d5d8d5eb-742f-4b30-9cf1-450311c850ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:47.081537 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d5d8d5eb-742f-4b30-9cf1-450311c850ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:47.083748 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=14 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:47.096644 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d5d8d5eb-742f-4b30-9cf1-450311c850ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:47.100086 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d5d8d5eb-742f-4b30-9cf1-450311c850ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:47.101087 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d5d8d5eb-742f-4b30-9cf1-450311c850ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:47.105471 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d5d8d5eb-742f-4b30-9cf1-450311c850ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:47.325136 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d5d8d5eb-742f-4b30-9cf1-450311c850ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:47.333212 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d5d8d5eb-742f-4b30-9cf1-450311c850ea tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.256535 Jul 14 12:18:47.337385 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 38/73] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:47 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:47.350377 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4b58b50e-f6dd-45dc-b4f0-9e4c9eb848f5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:47.359187 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4b58b50e-f6dd-45dc-b4f0-9e4c9eb848f5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.322957 Jul 14 12:18:47.360345 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 36/74] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:47 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:47.659703 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-769e1375-e40c-4782-bfe4-895d1fc8847e req-e5e29e13-8b1c-4ff7-803f-1601e893a8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7f193e-2bb2-42ac-a92a-e23f4fb316cb", "tag": "c4de4bd3-dc7b-4a40-a881-cdce6997d4fa"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:47.669856 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-769e1375-e40c-4782-bfe4-895d1fc8847e req-e5e29e13-8b1c-4ff7-803f-1601e893a8d9 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:47.670617 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-769e1375-e40c-4782-bfe4-895d1fc8847e req-e5e29e13-8b1c-4ff7-803f-1601e893a8d9 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:47.714497 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-769e1375-e40c-4782-bfe4-895d1fc8847e req-e5e29e13-8b1c-4ff7-803f-1601e893a8d9 service nova] Creating event network-changed:c4de4bd3-dc7b-4a40-a881-cdce6997d4fa for instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb on hv-cinder-84890 Jul 14 12:18:47.729422 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-769e1375-e40c-4782-bfe4-895d1fc8847e req-e5e29e13-8b1c-4ff7-803f-1601e893a8d9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076737 Jul 14 12:18:47.731237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 39/75] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:47.771290 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bafe2361-aefa-41b7-b802-544c16f8ba97 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:47.772528 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-bafe2361-aefa-41b7-b802-544c16f8ba97 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:47.791212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bafe2361-aefa-41b7-b802-544c16f8ba97 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:47.791917 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bafe2361-aefa-41b7-b802-544c16f8ba97 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:47.793293 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bafe2361-aefa-41b7-b802-544c16f8ba97 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:47.793760 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bafe2361-aefa-41b7-b802-544c16f8ba97 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:48.033928 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bafe2361-aefa-41b7-b802-544c16f8ba97 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:48.053331 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bafe2361-aefa-41b7-b802-544c16f8ba97 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.288632 Jul 14 12:18:48.068290 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 37/76] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:47 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:48.364619 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b85de181-8050-46b2-80b7-959f0eda47a5 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:48.364619 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b85de181-8050-46b2-80b7-959f0eda47a5 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:48.378722 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-359ac7b0-5eda-425b-9ce9-1f20926aeb75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:48.379731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-359ac7b0-5eda-425b-9ce9-1f20926aeb75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:48.391525 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b85de181-8050-46b2-80b7-959f0eda47a5 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:48.392573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b85de181-8050-46b2-80b7-959f0eda47a5 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:48.393705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b85de181-8050-46b2-80b7-959f0eda47a5 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:48.395543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-359ac7b0-5eda-425b-9ce9-1f20926aeb75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:48.397509 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b85de181-8050-46b2-80b7-959f0eda47a5 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:48.402119 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-359ac7b0-5eda-425b-9ce9-1f20926aeb75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:48.405753 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-359ac7b0-5eda-425b-9ce9-1f20926aeb75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:48.406439 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-359ac7b0-5eda-425b-9ce9-1f20926aeb75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:48.639725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b85de181-8050-46b2-80b7-959f0eda47a5 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:48.651457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b85de181-8050-46b2-80b7-959f0eda47a5 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.299875 Jul 14 12:18:48.652585 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 40/77] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:48 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:48.703263 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-359ac7b0-5eda-425b-9ce9-1f20926aeb75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:48.719652 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-359ac7b0-5eda-425b-9ce9-1f20926aeb75 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.345996 Jul 14 12:18:48.720828 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 38/78] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:48 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:49.075960 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4b2ecf80-7ea8-4fe4-a345-66f2b24cef5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:49.076580 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4b2ecf80-7ea8-4fe4-a345-66f2b24cef5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:49.083977 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4b2ecf80-7ea8-4fe4-a345-66f2b24cef5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:49.084415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4b2ecf80-7ea8-4fe4-a345-66f2b24cef5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:49.085613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4b2ecf80-7ea8-4fe4-a345-66f2b24cef5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:49.086049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4b2ecf80-7ea8-4fe4-a345-66f2b24cef5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:49.236042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e6c9e5da-f585-40d8-9b76-0e41fb7892b3 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Action: 'create', calling method: .version_select at 0x7f0e26a9ef70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-465879825", "metadata": {"Type": "work"}}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e6c9e5da-f585-40d8-9b76-0e41fb7892b3 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Request method failure captured: Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 121 Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Amo-6QsArfnRi84Je0e7DjP7jVnLpJEr0cSxCLklBIu-f7KD7iY7X7k0iqep_JeFrd0wBUEMCUCgC8wGztcFWBkx_7jGGaC6cWgFG1a9zqGGXRdLRck7RzY3MpaThV66G1SVdlUL1KXTqbziO4XpQwAHt-J1VA3R2dOaEbftZ-Bch8 Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:18:49.253355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75d81fcbf8bf44449966ccb19f79665b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 2fd51e56a8c54ce3a4d00c8213390773 Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-465879825", "metadata": {"Type": "work"}}} Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: Jul 14 12:18:49.254521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-465879825', 'metadata': {'Type': 'work'}}}} Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise error Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:49.255275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 12:18:49.256565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 12:18:49.257526 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 12:18:49.257526 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.259613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e6c9e5da-f585-40d8-9b76-0e41fb7892b3 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:49.259731 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4b2ecf80-7ea8-4fe4-a345-66f2b24cef5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:49.267027 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e6c9e5da-f585-40d8-9b76-0e41fb7892b3 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.184671 Jul 14 12:18:49.267027 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 39/79] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jul 14 12:18:49 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 188 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 12:18:49.270499 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4b2ecf80-7ea8-4fe4-a345-66f2b24cef5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.198528 Jul 14 12:18:49.271677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 41/80] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:49 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:49.282419 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-236e3180-bc3b-41bb-bcff-61b06dd3d372 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Action: 'create', calling method: .version_select at 0x7f0e26a69550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1310074256", "metadata": {"Type": "work"}}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-236e3180-bc3b-41bb-bcff-61b06dd3d372 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Request method failure captured: Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 120 Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Amo-6QsArfnRi84Je0e7DjP7jVnLpJEr0cSxCLklBIu-f7KD7iY7X7k0iqep_JeFrd0wBUEMCUCgC8wGztcFWBkx_7jGGaC6cWgFG1a9zqGGXRdLRck7RzY3MpaThV66G1SVdlUL1KXTqbziO4XpQwAHt-J1VA3R2dOaEbftZ-Bch8 Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:18:49.285102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75d81fcbf8bf44449966ccb19f79665b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 2fd51e56a8c54ce3a4d00c8213390773 Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1310074256", "metadata": {"Type": "work"}}} Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: Jul 14 12:18:49.286215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1310074256', 'metadata': {'Type': 'work'}}}} Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise error Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi '0' Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:49.286930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 12:18:49.288193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 12:18:49.291098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 12:18:49.291098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.291098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-236e3180-bc3b-41bb-bcff-61b06dd3d372 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:49.291761 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-236e3180-bc3b-41bb-bcff-61b06dd3d372 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022633 Jul 14 12:18:49.297424 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 40/81] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jul 14 12:18:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 12:18:49.304845 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e58445ac-1f7d-43d8-9817-77fa9295074e tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Action: 'create', calling method: .version_select at 0x7f0e2723e4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2119294491", "metadata": {"Type": "work"}}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e58445ac-1f7d-43d8-9817-77fa9295074e tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Request method failure captured: Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 119 Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Amo-6QsArfnRi84Je0e7DjP7jVnLpJEr0cSxCLklBIu-f7KD7iY7X7k0iqep_JeFrd0wBUEMCUCgC8wGztcFWBkx_7jGGaC6cWgFG1a9zqGGXRdLRck7RzY3MpaThV66G1SVdlUL1KXTqbziO4XpQwAHt-J1VA3R2dOaEbftZ-Bch8 Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:18:49.309115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75d81fcbf8bf44449966ccb19f79665b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 2fd51e56a8c54ce3a4d00c8213390773 Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2119294491", "metadata": {"Type": "work"}}} Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: Jul 14 12:18:49.311049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2119294491', 'metadata': {'Type': 'work'}}}} Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise error Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi '' Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:49.311705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 12:18:49.312800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 12:18:49.315015 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 12:18:49.315015 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.316175 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e58445ac-1f7d-43d8-9817-77fa9295074e tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:49.317208 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e58445ac-1f7d-43d8-9817-77fa9295074e tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018825 Jul 14 12:18:49.318308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 42/82] 10.222.0.27 () {60 vars in 1155 bytes} [Thu Jul 14 12:18:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 12:18:49.329504 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b4b4c440-1bd9-4cd6-a47d-350858a7d375 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Calling method '.version_select at 0x7f0e27b2c3a0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:49.363522 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-b4b4c440-1bd9-4cd6-a47d-350858a7d375 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] HTTP exception thrown: Volume tempest-invalid-1751522905 could not be found. Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b4b4c440-1bd9-4cd6-a47d-350858a7d375 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Request method failure captured: Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1751522905 HTTP/1.1 Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Amo-6QsArfnRi84Je0e7DjP7jVnLpJEr0cSxCLklBIu-f7KD7iY7X7k0iqep_JeFrd0wBUEMCUCgC8wGztcFWBkx_7jGGaC6cWgFG1a9zqGGXRdLRck7RzY3MpaThV66G1SVdlUL1KXTqbziO4XpQwAHt-J1VA3R2dOaEbftZ-Bch8 Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:18:49.365655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75d81fcbf8bf44449966ccb19f79665b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 2fd51e56a8c54ce3a4d00c8213390773 Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Volume tempest-invalid-1751522905 could not be found. Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'tempest-invalid-1751522905'} Jul 14 12:18:49.366755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1751522905 could not be found. (HTTP 404) (Request-ID: req-9df5477d-5193-4da4-8263-1b1c33f8fc9c) Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.367546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 12:18:49.368508 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1751522905 could not be found. Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:18:49.369539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1751522905 could not be found. Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1751522905 could not be found. Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b4b4c440-1bd9-4cd6-a47d-350858a7d375 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Returning 404 to user: Volume tempest-invalid-1751522905 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b4b4c440-1bd9-4cd6-a47d-350858a7d375 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1751522905" status: 404 len: 99 microversion: 2.1 time: 0.043195 Jul 14 12:18:49.380053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 41/83] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jul 14 12:18:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1751522905 => generated 99 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 12:18:49.380723 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0da954be-44f4-4737-9476-1e5d9fa5be23 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003746 Jul 14 12:18:49.380723 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 43/84] 10.222.0.27 () {58 vars in 1139 bytes} [Thu Jul 14 12:18:49 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 12:18:49.387023 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-723a7a45-6616-41fd-98de-30e771fcd748 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004070 Jul 14 12:18:49.390822 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 42/85] 10.222.0.27 () {58 vars in 1136 bytes} [Thu Jul 14 12:18:49 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 12:18:49.396445 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-34090483-89bf-478a-84c7-c6dc4663e5c3 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Calling method '.version_select at 0x7f0e272043a0>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:49.428340 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-34090483-89bf-478a-84c7-c6dc4663e5c3 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] HTTP exception thrown: Volume 440395f2-ef2b-43bd-b2d2-0b869ed487ef could not be found. Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-34090483-89bf-478a-84c7-c6dc4663e5c3 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Request method failure captured: Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: DELETE /compute/v2.1/os-volumes/440395f2-ef2b-43bd-b2d2-0b869ed487ef HTTP/1.1 Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Amo-6QsArfnRi84Je0e7DjP7jVnLpJEr0cSxCLklBIu-f7KD7iY7X7k0iqep_JeFrd0wBUEMCUCgC8wGztcFWBkx_7jGGaC6cWgFG1a9zqGGXRdLRck7RzY3MpaThV66G1SVdlUL1KXTqbziO4XpQwAHt-J1VA3R2dOaEbftZ-Bch8 Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:18:49.430287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75d81fcbf8bf44449966ccb19f79665b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 2fd51e56a8c54ce3a4d00c8213390773 Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Volume 440395f2-ef2b-43bd-b2d2-0b869ed487ef could not be found. Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '440395f2-ef2b-43bd-b2d2-0b869ed487ef'} Jul 14 12:18:49.431588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 440395f2-ef2b-43bd-b2d2-0b869ed487ef could not be found. (HTTP 404) (Request-ID: req-afbd8868-3526-42fc-a20c-273380e23897) Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.432253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 12:18:49.433189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 440395f2-ef2b-43bd-b2d2-0b869ed487ef could not be found. Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 12:18:49.434291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 440395f2-ef2b-43bd-b2d2-0b869ed487ef could not be found. Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 440395f2-ef2b-43bd-b2d2-0b869ed487ef could not be found. Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-34090483-89bf-478a-84c7-c6dc4663e5c3 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Returning 404 to user: Volume 440395f2-ef2b-43bd-b2d2-0b869ed487ef could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-34090483-89bf-478a-84c7-c6dc4663e5c3 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/440395f2-ef2b-43bd-b2d2-0b869ed487ef" status: 404 len: 109 microversion: 2.1 time: 0.039479 Jul 14 12:18:49.435266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 44/86] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:18:49 2022] DELETE /compute/v2.1/os-volumes/440395f2-ef2b-43bd-b2d2-0b869ed487ef => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:18:49.441609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-20c63c34-cebc-4fe3-90c8-419be45dcc00 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Calling method '.version_select at 0x7f0e28469ee0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:49.468649 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-20c63c34-cebc-4fe3-90c8-419be45dcc00 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] HTTP exception thrown: Volume 4bb5ef56-29ac-46f5-a239-125e08f14d82 could not be found. Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-20c63c34-cebc-4fe3-90c8-419be45dcc00 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Request method failure captured: Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/os-volumes/4bb5ef56-29ac-46f5-a239-125e08f14d82 HTTP/1.1 Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Amo-6QsArfnRi84Je0e7DjP7jVnLpJEr0cSxCLklBIu-f7KD7iY7X7k0iqep_JeFrd0wBUEMCUCgC8wGztcFWBkx_7jGGaC6cWgFG1a9zqGGXRdLRck7RzY3MpaThV66G1SVdlUL1KXTqbziO4XpQwAHt-J1VA3R2dOaEbftZ-Bch8 Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:18:49.471104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_75d81fcbf8bf44449966ccb19f79665b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/75d81fcbf8bf44449966ccb19f79665b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 75d81fcbf8bf44449966ccb19f79665b Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-VolumesNegativeTest-1261010784 Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 2fd51e56a8c54ce3a4d00c8213390773 Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-VolumesNegativeTest-1261010784-project Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Volume 4bb5ef56-29ac-46f5-a239-125e08f14d82 could not be found. Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '4bb5ef56-29ac-46f5-a239-125e08f14d82'} Jul 14 12:18:49.472495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4bb5ef56-29ac-46f5-a239-125e08f14d82 could not be found. (HTTP 404) (Request-ID: req-22bf8075-d6ab-4941-8445-b508179b092f) Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.473388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 12:18:49.474581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4bb5ef56-29ac-46f5-a239-125e08f14d82 could not be found. Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 12:18:49.476127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4bb5ef56-29ac-46f5-a239-125e08f14d82 could not be found. Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4bb5ef56-29ac-46f5-a239-125e08f14d82 could not be found. Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-20c63c34-cebc-4fe3-90c8-419be45dcc00 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] Returning 404 to user: Volume 4bb5ef56-29ac-46f5-a239-125e08f14d82 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-20c63c34-cebc-4fe3-90c8-419be45dcc00 tempest-VolumesNegativeTest-1261010784 tempest-VolumesNegativeTest-1261010784-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4bb5ef56-29ac-46f5-a239-125e08f14d82" status: 404 len: 109 microversion: 2.1 time: 0.034676 Jul 14 12:18:49.477542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 43/87] 10.222.0.27 () {58 vars in 1244 bytes} [Thu Jul 14 12:18:49 2022] GET /compute/v2.1/os-volumes/4bb5ef56-29ac-46f5-a239-125e08f14d82 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:18:49.670724 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-7a5f6e4a-5611-4a84-9b91-93d2d7317605 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:49.671436 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-7a5f6e4a-5611-4a84-9b91-93d2d7317605 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:49.677726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7a5f6e4a-5611-4a84-9b91-93d2d7317605 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:49.678560 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7a5f6e4a-5611-4a84-9b91-93d2d7317605 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:49.679572 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7a5f6e4a-5611-4a84-9b91-93d2d7317605 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:49.680075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7a5f6e4a-5611-4a84-9b91-93d2d7317605 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:49.740515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9a37257d-5441-4f71-b3fd-41deee9b5762 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:49.741342 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9a37257d-5441-4f71-b3fd-41deee9b5762 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:49.752862 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9a37257d-5441-4f71-b3fd-41deee9b5762 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:49.753896 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9a37257d-5441-4f71-b3fd-41deee9b5762 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:49.755499 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9a37257d-5441-4f71-b3fd-41deee9b5762 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:49.757293 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9a37257d-5441-4f71-b3fd-41deee9b5762 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:49.805146 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:49.949288 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-7a5f6e4a-5611-4a84-9b91-93d2d7317605 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:49.952543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9a37257d-5441-4f71-b3fd-41deee9b5762 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:49.958528 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-7a5f6e4a-5611-4a84-9b91-93d2d7317605 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.292792 Jul 14 12:18:49.959254 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 45/88] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:49 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:49.960544 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9a37257d-5441-4f71-b3fd-41deee9b5762 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.226877 Jul 14 12:18:49.961270 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 44/89] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:49 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:50.288086 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-7fd81b24-fd8c-410a-a24b-7e6c52ba73f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:50.289293 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-7fd81b24-fd8c-410a-a24b-7e6c52ba73f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:50.304556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7fd81b24-fd8c-410a-a24b-7e6c52ba73f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:50.307554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7fd81b24-fd8c-410a-a24b-7e6c52ba73f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:50.307554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7fd81b24-fd8c-410a-a24b-7e6c52ba73f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:50.307554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7fd81b24-fd8c-410a-a24b-7e6c52ba73f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:50.719866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-7fd81b24-fd8c-410a-a24b-7e6c52ba73f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:50.736599 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-7fd81b24-fd8c-410a-a24b-7e6c52ba73f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.452238 Jul 14 12:18:50.737183 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 46/90] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:50 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:50.977758 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7f7f6849-dfd6-4f42-998b-a7b81268f991 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:50.978409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7f7f6849-dfd6-4f42-998b-a7b81268f991 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:50.982918 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8a6c19b5-f943-47f0-b99d-cd83e4318e15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:50.983525 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8a6c19b5-f943-47f0-b99d-cd83e4318e15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:50.985488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7f7f6849-dfd6-4f42-998b-a7b81268f991 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:50.985968 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7f7f6849-dfd6-4f42-998b-a7b81268f991 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:50.986737 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7f7f6849-dfd6-4f42-998b-a7b81268f991 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:50.987268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7f7f6849-dfd6-4f42-998b-a7b81268f991 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:50.989571 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8a6c19b5-f943-47f0-b99d-cd83e4318e15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:50.990022 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8a6c19b5-f943-47f0-b99d-cd83e4318e15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:50.990840 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8a6c19b5-f943-47f0-b99d-cd83e4318e15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:50.991420 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8a6c19b5-f943-47f0-b99d-cd83e4318e15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:51.121997 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7f7f6849-dfd6-4f42-998b-a7b81268f991 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:51.128807 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8a6c19b5-f943-47f0-b99d-cd83e4318e15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:51.131286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7f7f6849-dfd6-4f42-998b-a7b81268f991 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.157541 Jul 14 12:18:51.131858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 45/91] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:50 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:51.138913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8a6c19b5-f943-47f0-b99d-cd83e4318e15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.160514 Jul 14 12:18:51.139485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 47/92] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:50 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:51.754917 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-db8ab8d6-08f6-4b78-b1ff-b95671bcfc88 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:51.755538 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-db8ab8d6-08f6-4b78-b1ff-b95671bcfc88 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:51.761749 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db8ab8d6-08f6-4b78-b1ff-b95671bcfc88 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:51.762924 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db8ab8d6-08f6-4b78-b1ff-b95671bcfc88 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:51.763692 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db8ab8d6-08f6-4b78-b1ff-b95671bcfc88 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:51.764129 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db8ab8d6-08f6-4b78-b1ff-b95671bcfc88 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:51.897820 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-db8ab8d6-08f6-4b78-b1ff-b95671bcfc88 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:51.906266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-db8ab8d6-08f6-4b78-b1ff-b95671bcfc88 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.154958 Jul 14 12:18:51.915337 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 46/93] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:51 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:52.148060 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-006fdb44-c220-4d86-859b-25dca7fd77fc tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:52.150250 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-006fdb44-c220-4d86-859b-25dca7fd77fc tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:52.156794 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-006fdb44-c220-4d86-859b-25dca7fd77fc tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:52.157575 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-006fdb44-c220-4d86-859b-25dca7fd77fc tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:52.158658 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-006fdb44-c220-4d86-859b-25dca7fd77fc tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:52.159347 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-006fdb44-c220-4d86-859b-25dca7fd77fc tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:52.159682 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-92813ebc-f883-4e21-86a5-337c28b46a51 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:52.160311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-92813ebc-f883-4e21-86a5-337c28b46a51 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:52.165199 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=100 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:52.168186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-92813ebc-f883-4e21-86a5-337c28b46a51 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:52.169497 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-92813ebc-f883-4e21-86a5-337c28b46a51 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:52.172236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-92813ebc-f883-4e21-86a5-337c28b46a51 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:52.172236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-92813ebc-f883-4e21-86a5-337c28b46a51 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:52.489373 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-92813ebc-f883-4e21-86a5-337c28b46a51 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:52.505113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-92813ebc-f883-4e21-86a5-337c28b46a51 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.351480 Jul 14 12:18:52.514590 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 47/94] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:52 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:52.514924 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-006fdb44-c220-4d86-859b-25dca7fd77fc tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:52.521741 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-006fdb44-c220-4d86-859b-25dca7fd77fc tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.377428 Jul 14 12:18:52.523846 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 48/95] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:52 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:52.923069 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4c24f1a5-4940-4298-b50f-df70b7943088 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:52.923603 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4c24f1a5-4940-4298-b50f-df70b7943088 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:52.930031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4c24f1a5-4940-4298-b50f-df70b7943088 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:52.930554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4c24f1a5-4940-4298-b50f-df70b7943088 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:52.932215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4c24f1a5-4940-4298-b50f-df70b7943088 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:52.932215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4c24f1a5-4940-4298-b50f-df70b7943088 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:53.180381 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4c24f1a5-4940-4298-b50f-df70b7943088 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:53.202934 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4c24f1a5-4940-4298-b50f-df70b7943088 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.283702 Jul 14 12:18:53.207199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 48/96] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:52 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:53.523353 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-44fcdb9e-68fe-42ad-aa64-5a11f61a96e9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:53.523979 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-44fcdb9e-68fe-42ad-aa64-5a11f61a96e9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:53.540602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-44fcdb9e-68fe-42ad-aa64-5a11f61a96e9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:53.544338 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-205b67f8-9133-49b1-a842-3b796bad82f6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:53.545666 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-205b67f8-9133-49b1-a842-3b796bad82f6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:53.548977 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-44fcdb9e-68fe-42ad-aa64-5a11f61a96e9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:53.550056 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-44fcdb9e-68fe-42ad-aa64-5a11f61a96e9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:53.552183 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-44fcdb9e-68fe-42ad-aa64-5a11f61a96e9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:53.564058 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-205b67f8-9133-49b1-a842-3b796bad82f6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:53.567384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-205b67f8-9133-49b1-a842-3b796bad82f6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:53.574091 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-205b67f8-9133-49b1-a842-3b796bad82f6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:53.575805 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-205b67f8-9133-49b1-a842-3b796bad82f6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:54.136832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-44fcdb9e-68fe-42ad-aa64-5a11f61a96e9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:54.147927 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-44fcdb9e-68fe-42ad-aa64-5a11f61a96e9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.629029 Jul 14 12:18:54.157920 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 49/97] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:53 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:54.222055 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ad07d162-1ba2-4879-b845-09346c5f0c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:54.223026 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ad07d162-1ba2-4879-b845-09346c5f0c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:54.237158 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad07d162-1ba2-4879-b845-09346c5f0c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:54.238840 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad07d162-1ba2-4879-b845-09346c5f0c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:54.241240 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad07d162-1ba2-4879-b845-09346c5f0c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:54.242074 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad07d162-1ba2-4879-b845-09346c5f0c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:54.288711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-205b67f8-9133-49b1-a842-3b796bad82f6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:54.300797 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-205b67f8-9133-49b1-a842-3b796bad82f6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.763855 Jul 14 12:18:54.318182 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 49/98] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:53 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:54.627145 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ad07d162-1ba2-4879-b845-09346c5f0c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:54.643170 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ad07d162-1ba2-4879-b845-09346c5f0c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.426448 Jul 14 12:18:54.654980 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 50/99] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:54 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:54.944689 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-4de7d15d-0ed4-423b-9bf0-bc35991dfacb req-59d573f2-abcc-44d5-8bfc-8e495646e30e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2634876-d37b-4436-9c61-23c72f9be7f0", "tag": "eb0f6ace-e868-4677-b659-dfad15db6256"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:54.973473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-4de7d15d-0ed4-423b-9bf0-bc35991dfacb req-59d573f2-abcc-44d5-8bfc-8e495646e30e service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:54.973932 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-4de7d15d-0ed4-423b-9bf0-bc35991dfacb req-59d573f2-abcc-44d5-8bfc-8e495646e30e service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:55.000200 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-4de7d15d-0ed4-423b-9bf0-bc35991dfacb req-59d573f2-abcc-44d5-8bfc-8e495646e30e service nova] Creating event network-changed:eb0f6ace-e868-4677-b659-dfad15db6256 for instance d2634876-d37b-4436-9c61-23c72f9be7f0 on hv-cinder-84890 Jul 14 12:18:55.001042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-4de7d15d-0ed4-423b-9bf0-bc35991dfacb req-59d573f2-abcc-44d5-8bfc-8e495646e30e service nova] Acquired lock "compute-rpcapi-router" {{(pid=118263) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 12:18:55.002222 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a03b4981-dc2b-40e6-b443-66b11f76d0af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:55.005232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a03b4981-dc2b-40e6-b443-66b11f76d0af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:55.005232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a03b4981-dc2b-40e6-b443-66b11f76d0af None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:55.005232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a03b4981-dc2b-40e6-b443-66b11f76d0af None None] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:55.014679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.compute.rpcapi [None req-a03b4981-dc2b-40e6-b443-66b11f76d0af None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 12:18:55.016554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a03b4981-dc2b-40e6-b443-66b11f76d0af None None] Releasing lock "compute-rpcapi-router" {{(pid=118263) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 12:18:55.044319 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a03b4981-dc2b-40e6-b443-66b11f76d0af None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184910 Jul 14 12:18:55.046234 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 50/100] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:18:55.165751 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-027be7e9-f088-483b-a182-4ad9621b025d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:55.166358 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-027be7e9-f088-483b-a182-4ad9621b025d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:55.173938 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-027be7e9-f088-483b-a182-4ad9621b025d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:55.174390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-027be7e9-f088-483b-a182-4ad9621b025d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:55.175177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-027be7e9-f088-483b-a182-4ad9621b025d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:55.175614 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-027be7e9-f088-483b-a182-4ad9621b025d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:55.319764 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-06d4db60-5d18-4e63-bcf2-67deff7c1b2a tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:55.321187 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-06d4db60-5d18-4e63-bcf2-67deff7c1b2a tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:55.330294 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-06d4db60-5d18-4e63-bcf2-67deff7c1b2a tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:55.330885 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-06d4db60-5d18-4e63-bcf2-67deff7c1b2a tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:55.331888 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-06d4db60-5d18-4e63-bcf2-67deff7c1b2a tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:55.332564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-06d4db60-5d18-4e63-bcf2-67deff7c1b2a tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:55.359232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-027be7e9-f088-483b-a182-4ad9621b025d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:55.369763 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-027be7e9-f088-483b-a182-4ad9621b025d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.206709 Jul 14 12:18:55.379559 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 51/101] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:55 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:55.471515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-06d4db60-5d18-4e63-bcf2-67deff7c1b2a tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:55.479440 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-06d4db60-5d18-4e63-bcf2-67deff7c1b2a tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.165639 Jul 14 12:18:55.481064 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 51/102] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:55 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:55.661043 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c299f4e9-d315-414e-b548-3bd30177cb70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:55.661686 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c299f4e9-d315-414e-b548-3bd30177cb70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:55.663693 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:55.668734 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c299f4e9-d315-414e-b548-3bd30177cb70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:55.669186 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c299f4e9-d315-414e-b548-3bd30177cb70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:55.669955 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c299f4e9-d315-414e-b548-3bd30177cb70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:55.670393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c299f4e9-d315-414e-b548-3bd30177cb70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:55.812320 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c299f4e9-d315-414e-b548-3bd30177cb70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:55.820334 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c299f4e9-d315-414e-b548-3bd30177cb70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.163121 Jul 14 12:18:55.820933 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 52/103] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:55 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:56.386433 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d71e1893-3e0c-4034-b89d-c4d4fb22a0d6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:56.387340 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d71e1893-3e0c-4034-b89d-c4d4fb22a0d6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:56.393937 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d71e1893-3e0c-4034-b89d-c4d4fb22a0d6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:56.396094 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d71e1893-3e0c-4034-b89d-c4d4fb22a0d6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:56.397381 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d71e1893-3e0c-4034-b89d-c4d4fb22a0d6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:56.398108 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d71e1893-3e0c-4034-b89d-c4d4fb22a0d6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:56.496840 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6e2dfc1d-f0a4-479c-92e5-5100cc906e09 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:56.497557 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6e2dfc1d-f0a4-479c-92e5-5100cc906e09 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:56.504207 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6e2dfc1d-f0a4-479c-92e5-5100cc906e09 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:56.504657 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6e2dfc1d-f0a4-479c-92e5-5100cc906e09 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:56.505428 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6e2dfc1d-f0a4-479c-92e5-5100cc906e09 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:56.505866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6e2dfc1d-f0a4-479c-92e5-5100cc906e09 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:56.539185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d71e1893-3e0c-4034-b89d-c4d4fb22a0d6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:56.551753 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d71e1893-3e0c-4034-b89d-c4d4fb22a0d6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.166127 Jul 14 12:18:56.561592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 52/104] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:56 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:56.672725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6e2dfc1d-f0a4-479c-92e5-5100cc906e09 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:56.680866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6e2dfc1d-f0a4-479c-92e5-5100cc906e09 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.187799 Jul 14 12:18:56.690569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 53/105] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:56 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:18:56.837165 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-14b82258-f3ac-4f6b-9979-37fc49c7184a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:56.837964 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-14b82258-f3ac-4f6b-9979-37fc49c7184a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:56.844914 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-14b82258-f3ac-4f6b-9979-37fc49c7184a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:56.845372 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-14b82258-f3ac-4f6b-9979-37fc49c7184a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:56.846264 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-14b82258-f3ac-4f6b-9979-37fc49c7184a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:56.846707 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-14b82258-f3ac-4f6b-9979-37fc49c7184a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:57.058339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-dfc3f440-b24d-4cca-880c-74138dfe4259 req-75c76af0-3653-4aba-b7ab-33f3347af002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a07e9511-3f33-44c5-8dfc-7ccdd3f12118", "tag": "63aff066-06a0-4d2d-843c-dc7c5ba642ad"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:18:57.072459 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-dfc3f440-b24d-4cca-880c-74138dfe4259 req-75c76af0-3653-4aba-b7ab-33f3347af002 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:57.072459 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-dfc3f440-b24d-4cca-880c-74138dfe4259 req-75c76af0-3653-4aba-b7ab-33f3347af002 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:57.078658 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-dfc3f440-b24d-4cca-880c-74138dfe4259 req-75c76af0-3653-4aba-b7ab-33f3347af002 service nova] Creating event network-changed:63aff066-06a0-4d2d-843c-dc7c5ba642ad for instance a07e9511-3f33-44c5-8dfc-7ccdd3f12118 on hv-cinder-84890 Jul 14 12:18:57.083451 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-dfc3f440-b24d-4cca-880c-74138dfe4259 req-75c76af0-3653-4aba-b7ab-33f3347af002 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028765 Jul 14 12:18:57.084044 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 54/106] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:18:57.135690 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-14b82258-f3ac-4f6b-9979-37fc49c7184a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:57.144051 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-14b82258-f3ac-4f6b-9979-37fc49c7184a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.310638 Jul 14 12:18:57.144637 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 53/107] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:56 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:57.568739 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-08d5b53d-5b5e-4b34-b7c8-9b689499b535 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:57.569505 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-08d5b53d-5b5e-4b34-b7c8-9b689499b535 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:57.576478 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-08d5b53d-5b5e-4b34-b7c8-9b689499b535 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:57.576834 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-08d5b53d-5b5e-4b34-b7c8-9b689499b535 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:57.577762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-08d5b53d-5b5e-4b34-b7c8-9b689499b535 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:57.578376 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-08d5b53d-5b5e-4b34-b7c8-9b689499b535 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:57.697883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8a0560c0-6c02-4788-af58-749e6057f6c6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:57.698461 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8a0560c0-6c02-4788-af58-749e6057f6c6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:57.705776 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a0560c0-6c02-4788-af58-749e6057f6c6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:57.713534 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a0560c0-6c02-4788-af58-749e6057f6c6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:57.713534 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a0560c0-6c02-4788-af58-749e6057f6c6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:57.713929 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a0560c0-6c02-4788-af58-749e6057f6c6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:57.739811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-08d5b53d-5b5e-4b34-b7c8-9b689499b535 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:57.748802 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-08d5b53d-5b5e-4b34-b7c8-9b689499b535 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.184244 Jul 14 12:18:57.749832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 55/108] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:57 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:57.896769 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8a0560c0-6c02-4788-af58-749e6057f6c6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:57.909782 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8a0560c0-6c02-4788-af58-749e6057f6c6 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.215390 Jul 14 12:18:57.910533 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 54/109] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:57 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:58.162933 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b46e234a-4ea2-4151-9b11-b68fd5cd278f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:58.163984 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b46e234a-4ea2-4151-9b11-b68fd5cd278f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:58.166329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:18:58.171713 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b46e234a-4ea2-4151-9b11-b68fd5cd278f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:58.172128 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b46e234a-4ea2-4151-9b11-b68fd5cd278f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:58.172900 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b46e234a-4ea2-4151-9b11-b68fd5cd278f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:58.173335 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b46e234a-4ea2-4151-9b11-b68fd5cd278f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:58.336014 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b46e234a-4ea2-4151-9b11-b68fd5cd278f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:58.344426 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b46e234a-4ea2-4151-9b11-b68fd5cd278f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.186457 Jul 14 12:18:58.354303 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 56/110] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:58 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:58.765775 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-19216c84-aeb7-44b3-856b-70f74fc4d73a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:58.766757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-19216c84-aeb7-44b3-856b-70f74fc4d73a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:58.773566 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-19216c84-aeb7-44b3-856b-70f74fc4d73a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:58.775345 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-19216c84-aeb7-44b3-856b-70f74fc4d73a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:58.776177 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-19216c84-aeb7-44b3-856b-70f74fc4d73a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:58.776629 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-19216c84-aeb7-44b3-856b-70f74fc4d73a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:58.927769 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a6ff0ca0-9279-4574-995d-abb0508e2c34 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:58.928322 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a6ff0ca0-9279-4574-995d-abb0508e2c34 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:58.936953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a6ff0ca0-9279-4574-995d-abb0508e2c34 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:58.937544 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a6ff0ca0-9279-4574-995d-abb0508e2c34 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:58.939694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a6ff0ca0-9279-4574-995d-abb0508e2c34 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:58.940861 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a6ff0ca0-9279-4574-995d-abb0508e2c34 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:58.989510 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-19216c84-aeb7-44b3-856b-70f74fc4d73a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:58.989510 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-19216c84-aeb7-44b3-856b-70f74fc4d73a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.226521 Jul 14 12:18:58.990254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 55/111] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:58 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:59.111671 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a6ff0ca0-9279-4574-995d-abb0508e2c34 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:59.119583 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a6ff0ca0-9279-4574-995d-abb0508e2c34 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.195623 Jul 14 12:18:59.125539 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 57/112] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:58 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:18:59.371026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-87da6d2a-613c-43f5-97ba-e9bdb83b63f1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:18:59.373494 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-87da6d2a-613c-43f5-97ba-e9bdb83b63f1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:18:59.380561 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-87da6d2a-613c-43f5-97ba-e9bdb83b63f1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:59.396574 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-87da6d2a-613c-43f5-97ba-e9bdb83b63f1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:59.398952 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-87da6d2a-613c-43f5-97ba-e9bdb83b63f1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:18:59.399821 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-87da6d2a-613c-43f5-97ba-e9bdb83b63f1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:18:59.796590 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-87da6d2a-613c-43f5-97ba-e9bdb83b63f1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:18:59.817412 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-87da6d2a-613c-43f5-97ba-e9bdb83b63f1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.451035 Jul 14 12:18:59.818485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 56/113] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:18:59 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:00.018964 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b24e0857-aa62-467d-95d1-8af9b259a62e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:00.019570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b24e0857-aa62-467d-95d1-8af9b259a62e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:00.026431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b24e0857-aa62-467d-95d1-8af9b259a62e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:00.026915 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b24e0857-aa62-467d-95d1-8af9b259a62e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:00.027773 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b24e0857-aa62-467d-95d1-8af9b259a62e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:00.028524 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b24e0857-aa62-467d-95d1-8af9b259a62e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:00.142016 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7ce6ee20-89ee-4905-a02a-8b3ce51277ad tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:00.142865 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7ce6ee20-89ee-4905-a02a-8b3ce51277ad tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:00.178221 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ce6ee20-89ee-4905-a02a-8b3ce51277ad tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:00.178708 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ce6ee20-89ee-4905-a02a-8b3ce51277ad tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:00.179568 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ce6ee20-89ee-4905-a02a-8b3ce51277ad tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:00.180012 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ce6ee20-89ee-4905-a02a-8b3ce51277ad tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:00.235263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b24e0857-aa62-467d-95d1-8af9b259a62e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:00.241178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b24e0857-aa62-467d-95d1-8af9b259a62e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.226223 Jul 14 12:19:00.241760 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 58/114] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:00 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:00.533232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7ce6ee20-89ee-4905-a02a-8b3ce51277ad tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:00.542011 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7ce6ee20-89ee-4905-a02a-8b3ce51277ad tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.404965 Jul 14 12:19:00.542881 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 57/115] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:00 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:00.836299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f7459a77-f7fd-497b-9f3c-c7343dd0a5e1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:00.836914 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f7459a77-f7fd-497b-9f3c-c7343dd0a5e1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:00.843298 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f7459a77-f7fd-497b-9f3c-c7343dd0a5e1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:00.843752 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f7459a77-f7fd-497b-9f3c-c7343dd0a5e1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:00.844515 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f7459a77-f7fd-497b-9f3c-c7343dd0a5e1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:00.844955 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f7459a77-f7fd-497b-9f3c-c7343dd0a5e1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:01.018392 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f7459a77-f7fd-497b-9f3c-c7343dd0a5e1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:01.028499 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f7459a77-f7fd-497b-9f3c-c7343dd0a5e1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.196352 Jul 14 12:19:01.032099 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 59/116] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:00 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:01.259811 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cbacf810-7637-4c28-ab55-8b415fd81914 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:01.266608 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-cbacf810-7637-4c28-ab55-8b415fd81914 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:01.267864 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cbacf810-7637-4c28-ab55-8b415fd81914 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:01.268515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cbacf810-7637-4c28-ab55-8b415fd81914 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:01.269992 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cbacf810-7637-4c28-ab55-8b415fd81914 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:01.271728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cbacf810-7637-4c28-ab55-8b415fd81914 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:01.447258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-cbacf810-7637-4c28-ab55-8b415fd81914 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:01.456566 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-cbacf810-7637-4c28-ab55-8b415fd81914 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.200620 Jul 14 12:19:01.457718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 58/117] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:01 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:01.560521 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f608fd7a-fb3d-4801-b49b-566bb77f07e0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:01.561141 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f608fd7a-fb3d-4801-b49b-566bb77f07e0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:01.567258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f608fd7a-fb3d-4801-b49b-566bb77f07e0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:01.567705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f608fd7a-fb3d-4801-b49b-566bb77f07e0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:01.568689 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f608fd7a-fb3d-4801-b49b-566bb77f07e0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:01.569294 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f608fd7a-fb3d-4801-b49b-566bb77f07e0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:01.829222 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f608fd7a-fb3d-4801-b49b-566bb77f07e0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:01.842248 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f608fd7a-fb3d-4801-b49b-566bb77f07e0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.284079 Jul 14 12:19:01.843121 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 60/118] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:01 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:01.865003 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-f673caf4-a3de-4b11-aea6-21030b6c4ac1 req-08f02fc2-e63b-4e94-b487-9d39093f3b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc2b616c-dc02-4d81-9eb1-028c8077a4fe", "name": "network-vif-plugged", "status": "completed", "tag": "cd1e3c51-3b14-4f81-94e0-3273cc7ab2dd"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:01.875892 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-f673caf4-a3de-4b11-aea6-21030b6c4ac1 req-08f02fc2-e63b-4e94-b487-9d39093f3b73 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:01.876625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-f673caf4-a3de-4b11-aea6-21030b6c4ac1 req-08f02fc2-e63b-4e94-b487-9d39093f3b73 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:01.892320 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-f673caf4-a3de-4b11-aea6-21030b6c4ac1 req-08f02fc2-e63b-4e94-b487-9d39093f3b73 service nova] Creating event network-vif-plugged:cd1e3c51-3b14-4f81-94e0-3273cc7ab2dd for instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe on hv-cinder-84890 Jul 14 12:19:01.904118 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-f673caf4-a3de-4b11-aea6-21030b6c4ac1 req-08f02fc2-e63b-4e94-b487-9d39093f3b73 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.266465 Jul 14 12:19:01.907743 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 59/119] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:19:02.048649 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-968447c7-af4c-4a39-ae29-f1523ca35afb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:02.049269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-968447c7-af4c-4a39-ae29-f1523ca35afb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:02.067225 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-968447c7-af4c-4a39-ae29-f1523ca35afb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:02.067720 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-968447c7-af4c-4a39-ae29-f1523ca35afb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:02.068549 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-968447c7-af4c-4a39-ae29-f1523ca35afb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:02.069028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-968447c7-af4c-4a39-ae29-f1523ca35afb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:02.226751 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-968447c7-af4c-4a39-ae29-f1523ca35afb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:02.242667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-968447c7-af4c-4a39-ae29-f1523ca35afb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.191596 Jul 14 12:19:02.242667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 61/120] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:02 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:02.475486 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4f8b5915-1066-4f60-b394-312a5a03d5fd tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:02.483783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4f8b5915-1066-4f60-b394-312a5a03d5fd tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:02.483783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4f8b5915-1066-4f60-b394-312a5a03d5fd tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:02.483783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4f8b5915-1066-4f60-b394-312a5a03d5fd tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:02.484261 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4f8b5915-1066-4f60-b394-312a5a03d5fd tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:02.484637 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4f8b5915-1066-4f60-b394-312a5a03d5fd tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:02.662114 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4f8b5915-1066-4f60-b394-312a5a03d5fd tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:02.673264 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4f8b5915-1066-4f60-b394-312a5a03d5fd tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.201651 Jul 14 12:19:02.683077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 60/121] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:02 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:02.861016 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-986b51a5-e1b7-45f4-a6ca-53536bb296af tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:02.861634 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-986b51a5-e1b7-45f4-a6ca-53536bb296af tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:02.868432 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-986b51a5-e1b7-45f4-a6ca-53536bb296af tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:02.869053 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-986b51a5-e1b7-45f4-a6ca-53536bb296af tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:02.869948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-986b51a5-e1b7-45f4-a6ca-53536bb296af tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:02.870584 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-986b51a5-e1b7-45f4-a6ca-53536bb296af tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:03.035300 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-986b51a5-e1b7-45f4-a6ca-53536bb296af tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:03.042760 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-986b51a5-e1b7-45f4-a6ca-53536bb296af tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.185787 Jul 14 12:19:03.044258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 62/122] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:02 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:03.256873 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ef905bc4-6f9b-4b02-89c5-222f4b9a46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:03.257506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ef905bc4-6f9b-4b02-89c5-222f4b9a46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:03.263795 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ef905bc4-6f9b-4b02-89c5-222f4b9a46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:03.264248 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ef905bc4-6f9b-4b02-89c5-222f4b9a46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:03.265013 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ef905bc4-6f9b-4b02-89c5-222f4b9a46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:03.265529 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ef905bc4-6f9b-4b02-89c5-222f4b9a46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:03.452749 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ef905bc4-6f9b-4b02-89c5-222f4b9a46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:03.460477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ef905bc4-6f9b-4b02-89c5-222f4b9a46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.207377 Jul 14 12:19:03.466821 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 61/123] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:03 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:03.691535 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8e853f01-4d40-4bb1-8d13-56e8a1514c18 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:03.693759 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8e853f01-4d40-4bb1-8d13-56e8a1514c18 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:03.701057 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8e853f01-4d40-4bb1-8d13-56e8a1514c18 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:03.701947 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8e853f01-4d40-4bb1-8d13-56e8a1514c18 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:03.702602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8e853f01-4d40-4bb1-8d13-56e8a1514c18 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:03.703116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8e853f01-4d40-4bb1-8d13-56e8a1514c18 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:03.857593 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8e853f01-4d40-4bb1-8d13-56e8a1514c18 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:03.865070 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8e853f01-4d40-4bb1-8d13-56e8a1514c18 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.177582 Jul 14 12:19:03.865631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 63/124] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:03 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:03.919316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-3b9caac5-c692-4f65-8a49-0ead93cd9e03 req-58039086-e8ca-41e3-8999-fe970a4af07d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7f193e-2bb2-42ac-a92a-e23f4fb316cb", "name": "network-vif-plugged", "status": "completed", "tag": "c4de4bd3-dc7b-4a40-a881-cdce6997d4fa"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:03.932094 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-3b9caac5-c692-4f65-8a49-0ead93cd9e03 req-58039086-e8ca-41e3-8999-fe970a4af07d service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:03.935267 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-3b9caac5-c692-4f65-8a49-0ead93cd9e03 req-58039086-e8ca-41e3-8999-fe970a4af07d service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:03.942502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:03.952879 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-3b9caac5-c692-4f65-8a49-0ead93cd9e03 req-58039086-e8ca-41e3-8999-fe970a4af07d service nova] Creating event network-vif-plugged:c4de4bd3-dc7b-4a40-a881-cdce6997d4fa for instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb on hv-cinder-84890 Jul 14 12:19:03.958499 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-3b9caac5-c692-4f65-8a49-0ead93cd9e03 req-58039086-e8ca-41e3-8999-fe970a4af07d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043459 Jul 14 12:19:03.959712 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 62/125] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:19:04.062473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-94ae52b4-4254-464c-9f5d-c22b07f13f4d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:04.063279 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-94ae52b4-4254-464c-9f5d-c22b07f13f4d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:04.071819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-94ae52b4-4254-464c-9f5d-c22b07f13f4d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:04.072266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-94ae52b4-4254-464c-9f5d-c22b07f13f4d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:04.073114 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-94ae52b4-4254-464c-9f5d-c22b07f13f4d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:04.073730 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-94ae52b4-4254-464c-9f5d-c22b07f13f4d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:04.275135 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-94ae52b4-4254-464c-9f5d-c22b07f13f4d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:04.292929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-94ae52b4-4254-464c-9f5d-c22b07f13f4d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.230937 Jul 14 12:19:04.292929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 64/126] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:04 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:04.480150 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-56426b24-59d5-4f13-aadf-0a127d45bdf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:04.483360 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-56426b24-59d5-4f13-aadf-0a127d45bdf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:04.495548 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-56426b24-59d5-4f13-aadf-0a127d45bdf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:04.496302 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-56426b24-59d5-4f13-aadf-0a127d45bdf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:04.501772 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-56426b24-59d5-4f13-aadf-0a127d45bdf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:04.502390 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-56426b24-59d5-4f13-aadf-0a127d45bdf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:04.704551 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-56426b24-59d5-4f13-aadf-0a127d45bdf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:04.712267 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-56426b24-59d5-4f13-aadf-0a127d45bdf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.238451 Jul 14 12:19:04.712863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 63/127] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:04 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:04.885688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3a139678-04d4-4e51-b279-0a75f6d38ebe tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:04.885688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3a139678-04d4-4e51-b279-0a75f6d38ebe tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:04.890458 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3a139678-04d4-4e51-b279-0a75f6d38ebe tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:04.890933 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3a139678-04d4-4e51-b279-0a75f6d38ebe tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:04.891708 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3a139678-04d4-4e51-b279-0a75f6d38ebe tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:04.892133 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3a139678-04d4-4e51-b279-0a75f6d38ebe tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:04.910753 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=100 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:05.035274 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3a139678-04d4-4e51-b279-0a75f6d38ebe tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:05.042502 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3a139678-04d4-4e51-b279-0a75f6d38ebe tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.163359 Jul 14 12:19:05.043466 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 65/128] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:04 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:05.307971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-16b6e3c5-3cd4-408a-b856-f719bef82115 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:05.308929 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-16b6e3c5-3cd4-408a-b856-f719bef82115 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:05.311812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:05.316448 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-16b6e3c5-3cd4-408a-b856-f719bef82115 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:05.316908 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-16b6e3c5-3cd4-408a-b856-f719bef82115 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:05.317685 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-16b6e3c5-3cd4-408a-b856-f719bef82115 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:05.318172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-16b6e3c5-3cd4-408a-b856-f719bef82115 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:05.486358 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-16b6e3c5-3cd4-408a-b856-f719bef82115 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:05.494127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-16b6e3c5-3cd4-408a-b856-f719bef82115 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.189914 Jul 14 12:19:05.494837 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 64/129] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:05 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:05.730946 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-29ca5f03-67da-42ad-9898-1b98a170a90f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:05.730946 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-29ca5f03-67da-42ad-9898-1b98a170a90f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:05.737603 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-29ca5f03-67da-42ad-9898-1b98a170a90f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:05.738298 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-29ca5f03-67da-42ad-9898-1b98a170a90f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:05.739091 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-29ca5f03-67da-42ad-9898-1b98a170a90f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:05.739696 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-29ca5f03-67da-42ad-9898-1b98a170a90f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:05.870563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-29ca5f03-67da-42ad-9898-1b98a170a90f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:05.877958 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-29ca5f03-67da-42ad-9898-1b98a170a90f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.152035 Jul 14 12:19:05.878525 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 66/130] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:05 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:06.058676 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-038bd3b3-a9f7-4e0e-930a-83a22acea22b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:06.059491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-038bd3b3-a9f7-4e0e-930a-83a22acea22b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:06.065948 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-038bd3b3-a9f7-4e0e-930a-83a22acea22b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:06.066394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-038bd3b3-a9f7-4e0e-930a-83a22acea22b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:06.067198 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-038bd3b3-a9f7-4e0e-930a-83a22acea22b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:06.067636 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-038bd3b3-a9f7-4e0e-930a-83a22acea22b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:06.201862 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-038bd3b3-a9f7-4e0e-930a-83a22acea22b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:06.209491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-038bd3b3-a9f7-4e0e-930a-83a22acea22b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.154648 Jul 14 12:19:06.210093 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 65/131] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:06 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:06.513804 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f5642f8d-03d8-4472-94b3-e28e1002488d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:06.518098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f5642f8d-03d8-4472-94b3-e28e1002488d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:06.520685 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f5642f8d-03d8-4472-94b3-e28e1002488d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:06.521328 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f5642f8d-03d8-4472-94b3-e28e1002488d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:06.522102 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f5642f8d-03d8-4472-94b3-e28e1002488d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:06.522566 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f5642f8d-03d8-4472-94b3-e28e1002488d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:06.660408 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f5642f8d-03d8-4472-94b3-e28e1002488d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:06.667867 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f5642f8d-03d8-4472-94b3-e28e1002488d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.158944 Jul 14 12:19:06.668973 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 67/132] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:06 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:06.895193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-eb383a32-77af-4fed-a7b7-8d5367a2efcd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:06.895764 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-eb383a32-77af-4fed-a7b7-8d5367a2efcd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:06.901721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-eb383a32-77af-4fed-a7b7-8d5367a2efcd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:06.902164 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-eb383a32-77af-4fed-a7b7-8d5367a2efcd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:06.902971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-eb383a32-77af-4fed-a7b7-8d5367a2efcd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:06.903617 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-eb383a32-77af-4fed-a7b7-8d5367a2efcd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:07.131548 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-eb383a32-77af-4fed-a7b7-8d5367a2efcd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:07.140124 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-eb383a32-77af-4fed-a7b7-8d5367a2efcd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.248717 Jul 14 12:19:07.140819 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 66/133] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:06 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:07.229929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-18dcd6d1-a7ee-400e-8f74-17a7cdd2d11b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:07.229929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-18dcd6d1-a7ee-400e-8f74-17a7cdd2d11b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:07.235029 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-18dcd6d1-a7ee-400e-8f74-17a7cdd2d11b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:07.235942 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-18dcd6d1-a7ee-400e-8f74-17a7cdd2d11b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:07.237077 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-18dcd6d1-a7ee-400e-8f74-17a7cdd2d11b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:07.238124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-18dcd6d1-a7ee-400e-8f74-17a7cdd2d11b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:07.404106 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-18dcd6d1-a7ee-400e-8f74-17a7cdd2d11b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:07.412768 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-18dcd6d1-a7ee-400e-8f74-17a7cdd2d11b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.190057 Jul 14 12:19:07.413356 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 68/134] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:07 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:07.501879 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-e9089a62-eacc-44e3-9332-0d92b7dc76ba req-d2956138-2aff-4a0f-a12d-9cd15fa28a10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2634876-d37b-4436-9c61-23c72f9be7f0", "name": "network-vif-plugged", "status": "completed", "tag": "eb0f6ace-e868-4677-b659-dfad15db6256"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:07.510511 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-e9089a62-eacc-44e3-9332-0d92b7dc76ba req-d2956138-2aff-4a0f-a12d-9cd15fa28a10 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:07.511216 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-e9089a62-eacc-44e3-9332-0d92b7dc76ba req-d2956138-2aff-4a0f-a12d-9cd15fa28a10 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:07.523176 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-e9089a62-eacc-44e3-9332-0d92b7dc76ba req-d2956138-2aff-4a0f-a12d-9cd15fa28a10 service nova] Creating event network-vif-plugged:eb0f6ace-e868-4677-b659-dfad15db6256 for instance d2634876-d37b-4436-9c61-23c72f9be7f0 on hv-cinder-84890 Jul 14 12:19:07.528877 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-e9089a62-eacc-44e3-9332-0d92b7dc76ba req-d2956138-2aff-4a0f-a12d-9cd15fa28a10 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030431 Jul 14 12:19:07.530468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 67/135] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:19:07.686654 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-70c2ec31-2c28-4e43-8b84-00f59ac9a183 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:07.687563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-70c2ec31-2c28-4e43-8b84-00f59ac9a183 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:07.695123 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70c2ec31-2c28-4e43-8b84-00f59ac9a183 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:07.696214 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70c2ec31-2c28-4e43-8b84-00f59ac9a183 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:07.697315 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70c2ec31-2c28-4e43-8b84-00f59ac9a183 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:07.719065 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70c2ec31-2c28-4e43-8b84-00f59ac9a183 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:07.855002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-70c2ec31-2c28-4e43-8b84-00f59ac9a183 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:07.863283 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-70c2ec31-2c28-4e43-8b84-00f59ac9a183 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.181830 Jul 14 12:19:07.864246 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 69/136] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:07 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:08.158724 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d30d94c6-d953-4053-bfb9-d0a804a41694 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:08.159440 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d30d94c6-d953-4053-bfb9-d0a804a41694 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:08.165584 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d30d94c6-d953-4053-bfb9-d0a804a41694 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:08.166031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d30d94c6-d953-4053-bfb9-d0a804a41694 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:08.166814 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d30d94c6-d953-4053-bfb9-d0a804a41694 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:08.167254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d30d94c6-d953-4053-bfb9-d0a804a41694 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:08.306029 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d30d94c6-d953-4053-bfb9-d0a804a41694 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:08.313766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d30d94c6-d953-4053-bfb9-d0a804a41694 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.159257 Jul 14 12:19:08.314330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 68/137] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:08 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:08.434466 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-eda2ec4b-4cf7-4bb0-91cd-44cf4aaf911e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:08.434466 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-eda2ec4b-4cf7-4bb0-91cd-44cf4aaf911e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:08.437139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eda2ec4b-4cf7-4bb0-91cd-44cf4aaf911e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:08.437585 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eda2ec4b-4cf7-4bb0-91cd-44cf4aaf911e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:08.438376 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eda2ec4b-4cf7-4bb0-91cd-44cf4aaf911e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:08.438826 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eda2ec4b-4cf7-4bb0-91cd-44cf4aaf911e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:08.588119 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-eda2ec4b-4cf7-4bb0-91cd-44cf4aaf911e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:08.595551 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-eda2ec4b-4cf7-4bb0-91cd-44cf4aaf911e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.169491 Jul 14 12:19:08.596116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 70/138] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:08 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:08.892484 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-848c2d0e-2196-4a91-85e0-d7085ee55ac9 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:08.893329 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-848c2d0e-2196-4a91-85e0-d7085ee55ac9 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:08.906369 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-848c2d0e-2196-4a91-85e0-d7085ee55ac9 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:08.906369 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-848c2d0e-2196-4a91-85e0-d7085ee55ac9 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:08.906369 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-848c2d0e-2196-4a91-85e0-d7085ee55ac9 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:08.906369 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-848c2d0e-2196-4a91-85e0-d7085ee55ac9 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:08.991518 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1420976755", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "networks": [{"uuid": "c7c0701d-ea07-40d2-a551-c26bc0c8851b"}]}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:09.080546 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.network.neutron [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] validate_networks() for [('c7c0701d-ea07-40d2-a551-c26bc0c8851b', None, None, None, None, None)] {{(pid=118262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:19:09.138933 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-848c2d0e-2196-4a91-85e0-d7085ee55ac9 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:09.167538 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-848c2d0e-2196-4a91-85e0-d7085ee55ac9 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.275114 Jul 14 12:19:09.178727 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 69/139] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:08 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:09.335826 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0a672e26-b0f0-4eb1-87b9-4b672e74c664 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:09.336716 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0a672e26-b0f0-4eb1-87b9-4b672e74c664 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:09.346449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0a672e26-b0f0-4eb1-87b9-4b672e74c664 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:09.347563 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0a672e26-b0f0-4eb1-87b9-4b672e74c664 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:09.350392 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0a672e26-b0f0-4eb1-87b9-4b672e74c664 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:09.350392 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0a672e26-b0f0-4eb1-87b9-4b672e74c664 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:09.478708 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Flavor limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:19:09.479161 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Image limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:19:09.479631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Flavor pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:19:09.480060 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Image pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:19:09.481098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:19:09.490221 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:09.490705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:09.491529 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:09.491964 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:09.492965 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0a672e26-b0f0-4eb1-87b9-4b672e74c664 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:09.501260 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0a672e26-b0f0-4eb1-87b9-4b672e74c664 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.173265 Jul 14 12:19:09.501912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 70/140] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:09 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:09.510264 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Getting quotas for project 8bf2b73c991f489d915d7124b5d24564. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:19:09.514924 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Getting quotas for user 3ccee18a56e44ccebfa14d264deb219b and project 8bf2b73c991f489d915d7124b5d24564. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:19:09.526017 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Going to run 1 instances... {{(pid=118262) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:19:09.528895 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:19:09.544763 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-9297bf67-3596-4c61-9a5b-37f3b8287163 req-fc39f2d3-eec1-46d2-8498-ea89a40a4cd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07e9511-3f33-44c5-8dfc-7ccdd3f12118", "name": "network-vif-plugged", "status": "completed", "tag": "63aff066-06a0-4d2d-843c-dc7c5ba642ad"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:09.552621 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-9297bf67-3596-4c61-9a5b-37f3b8287163 req-fc39f2d3-eec1-46d2-8498-ea89a40a4cd7 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:09.553083 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-9297bf67-3596-4c61-9a5b-37f3b8287163 req-fc39f2d3-eec1-46d2-8498-ea89a40a4cd7 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:09.564897 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-9297bf67-3596-4c61-9a5b-37f3b8287163 req-fc39f2d3-eec1-46d2-8498-ea89a40a4cd7 service nova] Creating event network-vif-plugged:63aff066-06a0-4d2d-843c-dc7c5ba642ad for instance a07e9511-3f33-44c5-8dfc-7ccdd3f12118 on hv-cinder-84890 Jul 14 12:19:09.569869 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-9297bf67-3596-4c61-9a5b-37f3b8287163 req-fc39f2d3-eec1-46d2-8498-ea89a40a4cd7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029100 Jul 14 12:19:09.570441 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 71/141] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:19:09.612813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-70e8d595-b988-4981-b71a-d7040735c038 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:09.614852 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-70e8d595-b988-4981-b71a-d7040735c038 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:09.619826 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-70e8d595-b988-4981-b71a-d7040735c038 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:09.620268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-70e8d595-b988-4981-b71a-d7040735c038 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:09.621057 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-70e8d595-b988-4981-b71a-d7040735c038 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:09.621492 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-70e8d595-b988-4981-b71a-d7040735c038 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:09.705732 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-761a0055-659a-4d7c-96bb-fe602d24600e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721175 Jul 14 12:19:09.711063 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 71/142] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:19:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:19:09.724345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2b30cb97-55a0-4be5-bd58-8712d719e1fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:09.725172 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2b30cb97-55a0-4be5-bd58-8712d719e1fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:09.783029 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-70e8d595-b988-4981-b71a-d7040735c038 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:09.790986 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-70e8d595-b988-4981-b71a-d7040735c038 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.182452 Jul 14 12:19:09.799214 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2b30cb97-55a0-4be5-bd58-8712d719e1fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:09.800689 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 72/143] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:09 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:09.806128 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2b30cb97-55a0-4be5-bd58-8712d719e1fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1214 microversion: 2.1 time: 0.093906 Jul 14 12:19:09.806690 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 72/144] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:09 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:10.185301 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-639936e9-039d-44c1-bb83-63c3f40c8f13 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:10.186475 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-639936e9-039d-44c1-bb83-63c3f40c8f13 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:10.192657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-639936e9-039d-44c1-bb83-63c3f40c8f13 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:10.193104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-639936e9-039d-44c1-bb83-63c3f40c8f13 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:10.193870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-639936e9-039d-44c1-bb83-63c3f40c8f13 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:10.194314 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-639936e9-039d-44c1-bb83-63c3f40c8f13 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:10.328678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-639936e9-039d-44c1-bb83-63c3f40c8f13 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:10.336119 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-639936e9-039d-44c1-bb83-63c3f40c8f13 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.154620 Jul 14 12:19:10.336684 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 73/145] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:10 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:10.517979 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1997bbdf-46c6-42e4-af4b-2eb9baf8b5d4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:10.518647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1997bbdf-46c6-42e4-af4b-2eb9baf8b5d4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:10.525465 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1997bbdf-46c6-42e4-af4b-2eb9baf8b5d4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:10.525906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1997bbdf-46c6-42e4-af4b-2eb9baf8b5d4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:10.526669 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1997bbdf-46c6-42e4-af4b-2eb9baf8b5d4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:10.527130 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1997bbdf-46c6-42e4-af4b-2eb9baf8b5d4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:10.654722 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1997bbdf-46c6-42e4-af4b-2eb9baf8b5d4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:10.662283 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1997bbdf-46c6-42e4-af4b-2eb9baf8b5d4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.148220 Jul 14 12:19:10.662886 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 73/146] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:10 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:10.807770 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5f4447f1-0a66-46d1-a826-1cc5a7ad2f7d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:10.808352 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5f4447f1-0a66-46d1-a826-1cc5a7ad2f7d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:10.815273 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5f4447f1-0a66-46d1-a826-1cc5a7ad2f7d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:10.815724 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5f4447f1-0a66-46d1-a826-1cc5a7ad2f7d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:10.816475 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5f4447f1-0a66-46d1-a826-1cc5a7ad2f7d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:10.816907 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5f4447f1-0a66-46d1-a826-1cc5a7ad2f7d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:10.823654 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0b28c2bc-0d2b-4069-8c41-e6d698686531 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:10.824413 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0b28c2bc-0d2b-4069-8c41-e6d698686531 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:10.944668 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5f4447f1-0a66-46d1-a826-1cc5a7ad2f7d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:10.952680 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5f4447f1-0a66-46d1-a826-1cc5a7ad2f7d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.148754 Jul 14 12:19:10.953291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 74/147] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:10 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:10.973858 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0b28c2bc-0d2b-4069-8c41-e6d698686531 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:10.981861 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0b28c2bc-0d2b-4069-8c41-e6d698686531 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1214 microversion: 2.1 time: 0.162334 Jul 14 12:19:10.983656 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 74/148] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:10 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:11.353575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-05be5f5b-541f-4c35-bff3-428025a59363 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:11.354488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-05be5f5b-541f-4c35-bff3-428025a59363 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:11.361357 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-05be5f5b-541f-4c35-bff3-428025a59363 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:11.361800 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-05be5f5b-541f-4c35-bff3-428025a59363 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:11.362582 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-05be5f5b-541f-4c35-bff3-428025a59363 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:11.363087 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-05be5f5b-541f-4c35-bff3-428025a59363 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:11.492328 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-05be5f5b-541f-4c35-bff3-428025a59363 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:11.501221 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-05be5f5b-541f-4c35-bff3-428025a59363 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.151640 Jul 14 12:19:11.501775 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 75/149] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:11 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:11.679882 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a3d9dcd9-374b-4dc8-838c-db986d85fb45 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:11.680499 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a3d9dcd9-374b-4dc8-838c-db986d85fb45 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:11.687364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a3d9dcd9-374b-4dc8-838c-db986d85fb45 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:11.687845 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a3d9dcd9-374b-4dc8-838c-db986d85fb45 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:11.688618 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a3d9dcd9-374b-4dc8-838c-db986d85fb45 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:11.689057 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a3d9dcd9-374b-4dc8-838c-db986d85fb45 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:11.820635 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a3d9dcd9-374b-4dc8-838c-db986d85fb45 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:11.828253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a3d9dcd9-374b-4dc8-838c-db986d85fb45 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.152408 Jul 14 12:19:11.828844 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 75/150] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:11 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:11.969332 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ca6068f9-9704-4e91-a8c5-6890566e51e1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:11.969939 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ca6068f9-9704-4e91-a8c5-6890566e51e1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:11.975989 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ca6068f9-9704-4e91-a8c5-6890566e51e1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:11.976430 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ca6068f9-9704-4e91-a8c5-6890566e51e1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:11.977198 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ca6068f9-9704-4e91-a8c5-6890566e51e1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:11.977626 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ca6068f9-9704-4e91-a8c5-6890566e51e1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:11.998625 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3f1abfed-f65d-4e6d-b17b-123d9e647061 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:11.999270 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3f1abfed-f65d-4e6d-b17b-123d9e647061 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:12.005152 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f1abfed-f65d-4e6d-b17b-123d9e647061 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:12.005600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f1abfed-f65d-4e6d-b17b-123d9e647061 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:12.006362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f1abfed-f65d-4e6d-b17b-123d9e647061 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:12.006821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f1abfed-f65d-4e6d-b17b-123d9e647061 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:12.067247 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3f1abfed-f65d-4e6d-b17b-123d9e647061 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:12.075186 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3f1abfed-f65d-4e6d-b17b-123d9e647061 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1218 microversion: 2.1 time: 0.080194 Jul 14 12:19:12.075761 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 76/151] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:11 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:12.112962 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ca6068f9-9704-4e91-a8c5-6890566e51e1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:12.120421 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ca6068f9-9704-4e91-a8c5-6890566e51e1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.155559 Jul 14 12:19:12.121027 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 76/152] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:11 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:12.517966 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ff323db3-9f7d-4cbc-8df2-bb990dc32942 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:12.518659 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ff323db3-9f7d-4cbc-8df2-bb990dc32942 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:12.524777 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ff323db3-9f7d-4cbc-8df2-bb990dc32942 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:12.525215 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ff323db3-9f7d-4cbc-8df2-bb990dc32942 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:12.525967 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ff323db3-9f7d-4cbc-8df2-bb990dc32942 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:12.526446 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ff323db3-9f7d-4cbc-8df2-bb990dc32942 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:12.659520 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ff323db3-9f7d-4cbc-8df2-bb990dc32942 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:12.667115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ff323db3-9f7d-4cbc-8df2-bb990dc32942 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1314 microversion: 2.1 time: 0.153542 Jul 14 12:19:12.667739 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 77/153] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:12 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:12.847150 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-db2f0e45-9997-49ac-b408-3bbd5c1a0b64 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:12.848041 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-db2f0e45-9997-49ac-b408-3bbd5c1a0b64 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:12.863494 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db2f0e45-9997-49ac-b408-3bbd5c1a0b64 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:12.863494 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db2f0e45-9997-49ac-b408-3bbd5c1a0b64 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:12.863494 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db2f0e45-9997-49ac-b408-3bbd5c1a0b64 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:12.863494 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db2f0e45-9997-49ac-b408-3bbd5c1a0b64 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:13.000270 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-db2f0e45-9997-49ac-b408-3bbd5c1a0b64 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:13.007671 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-db2f0e45-9997-49ac-b408-3bbd5c1a0b64 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.164847 Jul 14 12:19:13.008232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 77/154] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:12 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:13.092734 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-85c1aee3-fd0b-449d-81c0-6df867b53408 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:13.093569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-85c1aee3-fd0b-449d-81c0-6df867b53408 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:13.099905 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-85c1aee3-fd0b-449d-81c0-6df867b53408 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:13.100479 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-85c1aee3-fd0b-449d-81c0-6df867b53408 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:13.101326 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-85c1aee3-fd0b-449d-81c0-6df867b53408 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:13.101833 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-85c1aee3-fd0b-449d-81c0-6df867b53408 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:13.145161 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-28c0faf6-413f-4226-9dde-a17443e55941 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:13.145161 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-28c0faf6-413f-4226-9dde-a17443e55941 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:13.162165 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-28c0faf6-413f-4226-9dde-a17443e55941 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:13.162739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-28c0faf6-413f-4226-9dde-a17443e55941 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:13.165370 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-28c0faf6-413f-4226-9dde-a17443e55941 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:13.169222 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-28c0faf6-413f-4226-9dde-a17443e55941 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:13.179632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-85c1aee3-fd0b-449d-81c0-6df867b53408 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:13.203626 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-85c1aee3-fd0b-449d-81c0-6df867b53408 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1218 microversion: 2.1 time: 0.115302 Jul 14 12:19:13.204453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 78/155] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:13 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:13.308287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-28c0faf6-413f-4226-9dde-a17443e55941 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:13.316513 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-28c0faf6-413f-4226-9dde-a17443e55941 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.183651 Jul 14 12:19:13.317076 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 78/156] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:13 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:13.685496 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-82ba87a5-7c67-4905-b4df-484157d26196 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:13.686098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-82ba87a5-7c67-4905-b4df-484157d26196 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:13.692133 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-82ba87a5-7c67-4905-b4df-484157d26196 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:13.692579 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-82ba87a5-7c67-4905-b4df-484157d26196 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:13.693331 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-82ba87a5-7c67-4905-b4df-484157d26196 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:13.693762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-82ba87a5-7c67-4905-b4df-484157d26196 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:13.841945 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-82ba87a5-7c67-4905-b4df-484157d26196 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:13.851661 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-82ba87a5-7c67-4905-b4df-484157d26196 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1502 microversion: 2.1 time: 0.169908 Jul 14 12:19:13.863818 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 79/157] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:13 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1502 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:14.024492 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-78b113af-3355-47a0-85db-a397e844068b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:14.025102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-78b113af-3355-47a0-85db-a397e844068b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:14.033055 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-78b113af-3355-47a0-85db-a397e844068b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:14.033484 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-78b113af-3355-47a0-85db-a397e844068b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:14.034253 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-78b113af-3355-47a0-85db-a397e844068b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:14.034691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-78b113af-3355-47a0-85db-a397e844068b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:14.168324 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-78b113af-3355-47a0-85db-a397e844068b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:14.175952 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-78b113af-3355-47a0-85db-a397e844068b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.155320 Jul 14 12:19:14.176517 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 79/158] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:14 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:14.219919 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b2c7424e-bf04-4951-b350-c9331a22bb98 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:14.220616 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b2c7424e-bf04-4951-b350-c9331a22bb98 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:14.226517 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2c7424e-bf04-4951-b350-c9331a22bb98 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:14.227002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2c7424e-bf04-4951-b350-c9331a22bb98 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:14.227766 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2c7424e-bf04-4951-b350-c9331a22bb98 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:14.228180 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2c7424e-bf04-4951-b350-c9331a22bb98 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:14.294237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b2c7424e-bf04-4951-b350-c9331a22bb98 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:14.301751 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b2c7424e-bf04-4951-b350-c9331a22bb98 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1218 microversion: 2.1 time: 0.085589 Jul 14 12:19:14.302312 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 80/159] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:14 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:14.335603 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-01ae658c-1612-4c8b-90f8-977ccf71e470 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:14.336390 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-01ae658c-1612-4c8b-90f8-977ccf71e470 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:14.344138 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-01ae658c-1612-4c8b-90f8-977ccf71e470 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:14.344587 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-01ae658c-1612-4c8b-90f8-977ccf71e470 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:14.345353 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-01ae658c-1612-4c8b-90f8-977ccf71e470 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:14.345787 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-01ae658c-1612-4c8b-90f8-977ccf71e470 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:14.493279 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-01ae658c-1612-4c8b-90f8-977ccf71e470 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:14.498449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:14.503033 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-01ae658c-1612-4c8b-90f8-977ccf71e470 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1361 microversion: 2.1 time: 0.173377 Jul 14 12:19:14.503611 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 80/160] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:14 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:15.193189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-734ae6a4-8f63-436e-8fc0-ebf5ab6a768e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:15.193810 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-734ae6a4-8f63-436e-8fc0-ebf5ab6a768e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:15.213253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-734ae6a4-8f63-436e-8fc0-ebf5ab6a768e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:15.213772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-734ae6a4-8f63-436e-8fc0-ebf5ab6a768e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:15.214612 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-734ae6a4-8f63-436e-8fc0-ebf5ab6a768e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:15.215569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-734ae6a4-8f63-436e-8fc0-ebf5ab6a768e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:15.319919 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2dc8325e-2c74-4014-a4c3-b068a7d92c9a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:15.320682 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2dc8325e-2c74-4014-a4c3-b068a7d92c9a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:15.328456 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2dc8325e-2c74-4014-a4c3-b068a7d92c9a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:15.329338 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2dc8325e-2c74-4014-a4c3-b068a7d92c9a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:15.330958 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2dc8325e-2c74-4014-a4c3-b068a7d92c9a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:15.331855 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2dc8325e-2c74-4014-a4c3-b068a7d92c9a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:15.389635 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-734ae6a4-8f63-436e-8fc0-ebf5ab6a768e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:15.397076 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-734ae6a4-8f63-436e-8fc0-ebf5ab6a768e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.207629 Jul 14 12:19:15.407271 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 81/161] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:15 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:15.423664 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2dc8325e-2c74-4014-a4c3-b068a7d92c9a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:15.433283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2dc8325e-2c74-4014-a4c3-b068a7d92c9a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1218 microversion: 2.1 time: 0.117140 Jul 14 12:19:15.434232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 81/162] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:15 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:15.525549 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-036f7e65-b0e3-44b2-a9f6-9b60eba6ddc6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:15.526095 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-036f7e65-b0e3-44b2-a9f6-9b60eba6ddc6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:15.533444 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-036f7e65-b0e3-44b2-a9f6-9b60eba6ddc6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:15.533922 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-036f7e65-b0e3-44b2-a9f6-9b60eba6ddc6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:15.534679 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-036f7e65-b0e3-44b2-a9f6-9b60eba6ddc6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:15.535187 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-036f7e65-b0e3-44b2-a9f6-9b60eba6ddc6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:15.675346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-036f7e65-b0e3-44b2-a9f6-9b60eba6ddc6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:15.682915 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-036f7e65-b0e3-44b2-a9f6-9b60eba6ddc6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1546 microversion: 2.1 time: 0.161146 Jul 14 12:19:15.688215 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 82/163] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:15 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1546 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:15.701278 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-725979b6-cc54-4d12-b85b-47862afae3f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:15.701774 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-725979b6-cc54-4d12-b85b-47862afae3f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:15.707844 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-725979b6-cc54-4d12-b85b-47862afae3f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:15.708292 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-725979b6-cc54-4d12-b85b-47862afae3f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:15.709050 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-725979b6-cc54-4d12-b85b-47862afae3f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:15.709487 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-725979b6-cc54-4d12-b85b-47862afae3f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:15.998912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-725979b6-cc54-4d12-b85b-47862afae3f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.302076 Jul 14 12:19:15.999532 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 82/164] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 12:19:15 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/os-interface => generated 284 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:19:16.415021 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-226fbd0b-38bd-44f5-a82e-679531ebe2cf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:16.415641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-226fbd0b-38bd-44f5-a82e-679531ebe2cf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:16.422498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-226fbd0b-38bd-44f5-a82e-679531ebe2cf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:16.423217 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-226fbd0b-38bd-44f5-a82e-679531ebe2cf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:16.423986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-226fbd0b-38bd-44f5-a82e-679531ebe2cf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:16.424422 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-226fbd0b-38bd-44f5-a82e-679531ebe2cf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:16.428189 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-822c82c0-33aa-4b0d-a950-589516a90eed tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7ae0044-b412-4c05-8c9d-f7d4b6903ab9"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:16.436050 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-822c82c0-33aa-4b0d-a950-589516a90eed tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:16.437941 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-822c82c0-33aa-4b0d-a950-589516a90eed tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:16.438465 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-822c82c0-33aa-4b0d-a950-589516a90eed tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:16.439498 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-822c82c0-33aa-4b0d-a950-589516a90eed tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:16.440001 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-822c82c0-33aa-4b0d-a950-589516a90eed tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:16.621989 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-226fbd0b-38bd-44f5-a82e-679531ebe2cf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:16.625898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-226fbd0b-38bd-44f5-a82e-679531ebe2cf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1321 microversion: 2.1 time: 0.215034 Jul 14 12:19:16.627995 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 83/165] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:16 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:16.643553 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-921895c3-5366-4efe-a994-3dfd414735eb tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:16.646430 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-921895c3-5366-4efe-a994-3dfd414735eb tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:16.650394 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-921895c3-5366-4efe-a994-3dfd414735eb tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:16.651131 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-921895c3-5366-4efe-a994-3dfd414735eb tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:16.651892 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-921895c3-5366-4efe-a994-3dfd414735eb tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:16.652989 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-921895c3-5366-4efe-a994-3dfd414735eb tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:16.722467 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-921895c3-5366-4efe-a994-3dfd414735eb tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:16.725973 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=100 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:16.733417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-921895c3-5366-4efe-a994-3dfd414735eb tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1266 microversion: 2.1 time: 0.104188 Jul 14 12:19:16.734049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 84/166] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:16 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:17.264602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-e499f7ed-4425-402d-acc7-7be55a6b6d82 req-a28a58e9-800b-4ef9-b0e2-fd14d4080db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2634876-d37b-4436-9c61-23c72f9be7f0", "tag": "eb0f6ace-e868-4677-b659-dfad15db6256"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:17.274800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-e499f7ed-4425-402d-acc7-7be55a6b6d82 req-a28a58e9-800b-4ef9-b0e2-fd14d4080db2 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:17.275326 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-e499f7ed-4425-402d-acc7-7be55a6b6d82 req-a28a58e9-800b-4ef9-b0e2-fd14d4080db2 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:17.286509 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-e499f7ed-4425-402d-acc7-7be55a6b6d82 req-a28a58e9-800b-4ef9-b0e2-fd14d4080db2 service nova] Creating event network-changed:eb0f6ace-e868-4677-b659-dfad15db6256 for instance d2634876-d37b-4436-9c61-23c72f9be7f0 on hv-cinder-84890 Jul 14 12:19:17.292198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-e499f7ed-4425-402d-acc7-7be55a6b6d82 req-a28a58e9-800b-4ef9-b0e2-fd14d4080db2 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032629 Jul 14 12:19:17.295605 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 85/167] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:19:17.646217 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-05c8535b-b2ff-4340-bcac-3443cee5112a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:17.650946 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-05c8535b-b2ff-4340-bcac-3443cee5112a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:17.654929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-05c8535b-b2ff-4340-bcac-3443cee5112a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:17.655053 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-05c8535b-b2ff-4340-bcac-3443cee5112a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:17.655862 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-05c8535b-b2ff-4340-bcac-3443cee5112a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:17.656478 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-05c8535b-b2ff-4340-bcac-3443cee5112a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:17.829204 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-05c8535b-b2ff-4340-bcac-3443cee5112a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:17.836860 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-05c8535b-b2ff-4340-bcac-3443cee5112a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1516 microversion: 2.1 time: 0.194846 Jul 14 12:19:17.837618 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 86/168] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:17 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:17.847167 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e24d7ea4-136d-4598-aab8-40f4e5bd5dd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:17.847904 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e24d7ea4-136d-4598-aab8-40f4e5bd5dd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:17.854630 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e24d7ea4-136d-4598-aab8-40f4e5bd5dd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:17.856210 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e24d7ea4-136d-4598-aab8-40f4e5bd5dd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:17.856995 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e24d7ea4-136d-4598-aab8-40f4e5bd5dd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:17.857433 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e24d7ea4-136d-4598-aab8-40f4e5bd5dd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:17.943911 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e24d7ea4-136d-4598-aab8-40f4e5bd5dd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:17.954356 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e24d7ea4-136d-4598-aab8-40f4e5bd5dd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1274 microversion: 2.1 time: 0.115554 Jul 14 12:19:17.956091 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 87/169] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:17 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1274 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:17.980547 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c2e809d0-a037-43ee-bc67-20e0941b2add tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:17.980547 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c2e809d0-a037-43ee-bc67-20e0941b2add tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:17.984107 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2e809d0-a037-43ee-bc67-20e0941b2add tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:17.984561 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2e809d0-a037-43ee-bc67-20e0941b2add tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:17.986086 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2e809d0-a037-43ee-bc67-20e0941b2add tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:17.986944 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2e809d0-a037-43ee-bc67-20e0941b2add tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:18.063133 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-c2e809d0-a037-43ee-bc67-20e0941b2add tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lazy-loading 'flavor' on Instance uuid a07e9511-3f33-44c5-8dfc-7ccdd3f12118 {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:19:18.479519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c2e809d0-a037-43ee-bc67-20e0941b2add tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118/action" status: 200 len: 32 microversion: 2.1 time: 0.519407 Jul 14 12:19:18.480150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 88/170] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:19:17 2022] POST /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118/action => generated 32 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 12:19:18.494057 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-7da9d9be-84c0-4a2d-acda-261814d4598f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:18.496515 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-7da9d9be-84c0-4a2d-acda-261814d4598f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:18.519903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7da9d9be-84c0-4a2d-acda-261814d4598f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:18.521554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7da9d9be-84c0-4a2d-acda-261814d4598f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:18.529369 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7da9d9be-84c0-4a2d-acda-261814d4598f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:18.529369 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7da9d9be-84c0-4a2d-acda-261814d4598f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:18.845614 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-7da9d9be-84c0-4a2d-acda-261814d4598f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:18.861123 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-7da9d9be-84c0-4a2d-acda-261814d4598f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.373266 Jul 14 12:19:18.871991 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 89/171] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:18 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:18.985141 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0fa52019-31a2-4f11-a661-04cdaad4bfd9 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:18.988277 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0fa52019-31a2-4f11-a661-04cdaad4bfd9 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:19.010490 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0fa52019-31a2-4f11-a661-04cdaad4bfd9 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:19.011055 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0fa52019-31a2-4f11-a661-04cdaad4bfd9 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:19.013728 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0fa52019-31a2-4f11-a661-04cdaad4bfd9 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:19.014228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0fa52019-31a2-4f11-a661-04cdaad4bfd9 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:19.068659 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-822c82c0-33aa-4b0d-a950-589516a90eed tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "POST /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.648886 Jul 14 12:19:19.075610 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 83/172] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:19:16 2022] POST /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb/os-volume_attachments => generated 194 bytes in 2652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:19:19.461244 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0fa52019-31a2-4f11-a661-04cdaad4bfd9 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:19.471032 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0fa52019-31a2-4f11-a661-04cdaad4bfd9 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1272 microversion: 2.1 time: 0.500809 Jul 14 12:19:19.472202 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 90/173] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:18 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1272 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:19.885665 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-db454fa2-fb44-4e62-877d-1f6c5b0301f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:19.886600 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-db454fa2-fb44-4e62-877d-1f6c5b0301f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:19.888638 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=88 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:19.893773 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db454fa2-fb44-4e62-877d-1f6c5b0301f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:19.894489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db454fa2-fb44-4e62-877d-1f6c5b0301f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:19.895174 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db454fa2-fb44-4e62-877d-1f6c5b0301f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:19.895634 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-db454fa2-fb44-4e62-877d-1f6c5b0301f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:20.310178 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-db454fa2-fb44-4e62-877d-1f6c5b0301f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:20.320220 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-db454fa2-fb44-4e62-877d-1f6c5b0301f7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.436744 Jul 14 12:19:20.328115 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 84/174] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:19 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:20.489805 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ad1660d3-e4a7-43da-b547-3e68740f2bfc tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:20.490996 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ad1660d3-e4a7-43da-b547-3e68740f2bfc tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:20.494219 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:20.509531 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad1660d3-e4a7-43da-b547-3e68740f2bfc tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:20.512792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad1660d3-e4a7-43da-b547-3e68740f2bfc tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:20.514124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad1660d3-e4a7-43da-b547-3e68740f2bfc tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:20.515780 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad1660d3-e4a7-43da-b547-3e68740f2bfc tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:20.679936 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ad1660d3-e4a7-43da-b547-3e68740f2bfc tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:20.687973 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ad1660d3-e4a7-43da-b547-3e68740f2bfc tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.202179 Jul 14 12:19:20.694684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 91/175] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:20 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:21.335471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-6be10001-6c78-420f-a60f-7829e6abaca8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:21.336104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-6be10001-6c78-420f-a60f-7829e6abaca8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:21.345747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6be10001-6c78-420f-a60f-7829e6abaca8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:21.346203 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6be10001-6c78-420f-a60f-7829e6abaca8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:21.347016 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6be10001-6c78-420f-a60f-7829e6abaca8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:21.347707 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6be10001-6c78-420f-a60f-7829e6abaca8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:21.546792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6be10001-6c78-420f-a60f-7829e6abaca8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:21.558708 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-6be10001-6c78-420f-a60f-7829e6abaca8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.226995 Jul 14 12:19:21.559542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 85/176] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:21 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:21.693248 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-6da13ada-f78c-4aa3-92fd-2122b70ecf54 req-b940584b-003d-4847-9615-6d5b1cf8617c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1629fa-7e62-4b9d-9b3f-5781ca63efb3", "tag": "327eab00-b490-4f1e-b8ec-760ae8cb63af"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:21.696309 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=10 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:21.705334 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-163d7032-6e11-4040-889d-310c0803a0e5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:21.706616 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-163d7032-6e11-4040-889d-310c0803a0e5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:21.708173 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-6da13ada-f78c-4aa3-92fd-2122b70ecf54 req-b940584b-003d-4847-9615-6d5b1cf8617c service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:21.708625 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-6da13ada-f78c-4aa3-92fd-2122b70ecf54 req-b940584b-003d-4847-9615-6d5b1cf8617c service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:21.713713 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-163d7032-6e11-4040-889d-310c0803a0e5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:21.714908 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-163d7032-6e11-4040-889d-310c0803a0e5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:21.720152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-163d7032-6e11-4040-889d-310c0803a0e5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:21.720152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-163d7032-6e11-4040-889d-310c0803a0e5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:21.740626 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-6da13ada-f78c-4aa3-92fd-2122b70ecf54 req-b940584b-003d-4847-9615-6d5b1cf8617c service nova] Creating event network-changed:327eab00-b490-4f1e-b8ec-760ae8cb63af for instance ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 on hv-cinder-84890 Jul 14 12:19:21.753139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-6da13ada-f78c-4aa3-92fd-2122b70ecf54 req-b940584b-003d-4847-9615-6d5b1cf8617c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066980 Jul 14 12:19:21.754229 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 92/177] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:19:22.179822 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-163d7032-6e11-4040-889d-310c0803a0e5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:22.189600 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-163d7032-6e11-4040-889d-310c0803a0e5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.488255 Jul 14 12:19:22.198948 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 86/178] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:21 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:22.578268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d35508df-e1d2-41bc-a7b4-9b68073f4a55 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:22.579249 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d35508df-e1d2-41bc-a7b4-9b68073f4a55 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:22.586519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d35508df-e1d2-41bc-a7b4-9b68073f4a55 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:22.587101 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d35508df-e1d2-41bc-a7b4-9b68073f4a55 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:22.587973 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d35508df-e1d2-41bc-a7b4-9b68073f4a55 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:22.588687 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d35508df-e1d2-41bc-a7b4-9b68073f4a55 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:22.763837 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d35508df-e1d2-41bc-a7b4-9b68073f4a55 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:22.771881 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d35508df-e1d2-41bc-a7b4-9b68073f4a55 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.198775 Jul 14 12:19:22.776012 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 93/179] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:22 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:23.206500 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-018f5dd7-0c6b-488f-bd91-e3e0b6cca3c6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:23.207165 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-018f5dd7-0c6b-488f-bd91-e3e0b6cca3c6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:23.214458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-018f5dd7-0c6b-488f-bd91-e3e0b6cca3c6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:23.215371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-018f5dd7-0c6b-488f-bd91-e3e0b6cca3c6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:23.216384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-018f5dd7-0c6b-488f-bd91-e3e0b6cca3c6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:23.216913 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-018f5dd7-0c6b-488f-bd91-e3e0b6cca3c6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:23.353569 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-018f5dd7-0c6b-488f-bd91-e3e0b6cca3c6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:23.361861 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-018f5dd7-0c6b-488f-bd91-e3e0b6cca3c6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.158963 Jul 14 12:19:23.362734 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 87/180] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:23 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:23.791748 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e68d601a-e1ae-4b7f-b070-992c59945d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:23.792366 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e68d601a-e1ae-4b7f-b070-992c59945d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:23.798744 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e68d601a-e1ae-4b7f-b070-992c59945d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:23.799222 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e68d601a-e1ae-4b7f-b070-992c59945d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:23.799989 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e68d601a-e1ae-4b7f-b070-992c59945d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:23.800425 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e68d601a-e1ae-4b7f-b070-992c59945d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:23.962638 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e68d601a-e1ae-4b7f-b070-992c59945d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:23.971529 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e68d601a-e1ae-4b7f-b070-992c59945d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.183589 Jul 14 12:19:23.972091 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 94/181] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:23 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:24.378959 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a60a657d-426d-4478-ab5c-2737b0c72d28 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:24.379580 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a60a657d-426d-4478-ab5c-2737b0c72d28 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:24.386100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a60a657d-426d-4478-ab5c-2737b0c72d28 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:24.387460 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a60a657d-426d-4478-ab5c-2737b0c72d28 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:24.387857 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a60a657d-426d-4478-ab5c-2737b0c72d28 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:24.388295 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a60a657d-426d-4478-ab5c-2737b0c72d28 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:24.541505 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a60a657d-426d-4478-ab5c-2737b0c72d28 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:24.561281 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a60a657d-426d-4478-ab5c-2737b0c72d28 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.184193 Jul 14 12:19:24.561281 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 88/182] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:24 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:24.988641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-78565976-884f-491b-9ab0-e09ff3fe0aba tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:24.990052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-78565976-884f-491b-9ab0-e09ff3fe0aba tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:24.997529 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-78565976-884f-491b-9ab0-e09ff3fe0aba tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:24.998124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-78565976-884f-491b-9ab0-e09ff3fe0aba tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:24.998751 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-78565976-884f-491b-9ab0-e09ff3fe0aba tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:25.000898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-78565976-884f-491b-9ab0-e09ff3fe0aba tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:25.159906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-78565976-884f-491b-9ab0-e09ff3fe0aba tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:25.169563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-78565976-884f-491b-9ab0-e09ff3fe0aba tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.184836 Jul 14 12:19:25.170443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 95/183] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:24 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:25.577865 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4dbe0289-5f49-44b5-8ed4-93d0679acff0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:25.578522 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4dbe0289-5f49-44b5-8ed4-93d0679acff0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:25.584746 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4dbe0289-5f49-44b5-8ed4-93d0679acff0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:25.585197 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4dbe0289-5f49-44b5-8ed4-93d0679acff0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:25.585968 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4dbe0289-5f49-44b5-8ed4-93d0679acff0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:25.586433 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4dbe0289-5f49-44b5-8ed4-93d0679acff0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:25.724100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4dbe0289-5f49-44b5-8ed4-93d0679acff0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:25.732191 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4dbe0289-5f49-44b5-8ed4-93d0679acff0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.160336 Jul 14 12:19:25.732756 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 89/184] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:25 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:26.186978 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-282cff3f-5b09-4c1f-9c7f-12a5d1bf4c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:26.189899 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-282cff3f-5b09-4c1f-9c7f-12a5d1bf4c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:26.193542 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-282cff3f-5b09-4c1f-9c7f-12a5d1bf4c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:26.193993 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-282cff3f-5b09-4c1f-9c7f-12a5d1bf4c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:26.194749 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-282cff3f-5b09-4c1f-9c7f-12a5d1bf4c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:26.195208 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-282cff3f-5b09-4c1f-9c7f-12a5d1bf4c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:26.328069 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-282cff3f-5b09-4c1f-9c7f-12a5d1bf4c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:26.335581 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-282cff3f-5b09-4c1f-9c7f-12a5d1bf4c99 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.152764 Jul 14 12:19:26.336148 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 96/185] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:26 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:26.748542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-6b52a0f4-871f-42de-bf5f-36a00a64b4ef tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:26.749088 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-6b52a0f4-871f-42de-bf5f-36a00a64b4ef tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:26.755809 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6b52a0f4-871f-42de-bf5f-36a00a64b4ef tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:26.756255 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6b52a0f4-871f-42de-bf5f-36a00a64b4ef tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:26.757015 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6b52a0f4-871f-42de-bf5f-36a00a64b4ef tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:26.757496 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6b52a0f4-871f-42de-bf5f-36a00a64b4ef tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:26.895207 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6b52a0f4-871f-42de-bf5f-36a00a64b4ef tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:26.903363 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-6b52a0f4-871f-42de-bf5f-36a00a64b4ef tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.158987 Jul 14 12:19:26.903984 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 90/186] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:26 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:27.353716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ab29e57d-0da7-4a5f-8ad8-3abd0536a941 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:27.354470 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ab29e57d-0da7-4a5f-8ad8-3abd0536a941 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:27.359314 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:27.363795 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ab29e57d-0da7-4a5f-8ad8-3abd0536a941 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:27.364252 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ab29e57d-0da7-4a5f-8ad8-3abd0536a941 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:27.365063 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ab29e57d-0da7-4a5f-8ad8-3abd0536a941 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:27.365501 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ab29e57d-0da7-4a5f-8ad8-3abd0536a941 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:27.516304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ab29e57d-0da7-4a5f-8ad8-3abd0536a941 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:27.526738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ab29e57d-0da7-4a5f-8ad8-3abd0536a941 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.177777 Jul 14 12:19:27.527719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 97/187] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:27 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:27.920433 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-461fd4e0-1df3-41d7-90d1-2002fb625e0d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:27.921373 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-461fd4e0-1df3-41d7-90d1-2002fb625e0d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:27.927858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-461fd4e0-1df3-41d7-90d1-2002fb625e0d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:27.928311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-461fd4e0-1df3-41d7-90d1-2002fb625e0d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:27.929077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-461fd4e0-1df3-41d7-90d1-2002fb625e0d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:27.929519 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-461fd4e0-1df3-41d7-90d1-2002fb625e0d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:28.069259 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-461fd4e0-1df3-41d7-90d1-2002fb625e0d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:28.090656 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-461fd4e0-1df3-41d7-90d1-2002fb625e0d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.174196 Jul 14 12:19:28.091359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 91/188] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:27 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:28.544196 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-de8bb6ed-a5c0-40b2-a339-a70c35be4fa9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:28.544834 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-de8bb6ed-a5c0-40b2-a339-a70c35be4fa9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:28.551211 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-de8bb6ed-a5c0-40b2-a339-a70c35be4fa9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:28.551661 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-de8bb6ed-a5c0-40b2-a339-a70c35be4fa9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:28.552428 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-de8bb6ed-a5c0-40b2-a339-a70c35be4fa9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:28.553038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-de8bb6ed-a5c0-40b2-a339-a70c35be4fa9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:28.707526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-de8bb6ed-a5c0-40b2-a339-a70c35be4fa9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:28.736446 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-de8bb6ed-a5c0-40b2-a339-a70c35be4fa9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.196263 Jul 14 12:19:28.737052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 98/189] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:28 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:29.108084 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-76052f9b-eac0-4a7a-8614-d27ff1d446ba tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:29.108767 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-76052f9b-eac0-4a7a-8614-d27ff1d446ba tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:29.116056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-76052f9b-eac0-4a7a-8614-d27ff1d446ba tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:29.116693 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-76052f9b-eac0-4a7a-8614-d27ff1d446ba tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:29.117460 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-76052f9b-eac0-4a7a-8614-d27ff1d446ba tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:29.118088 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-76052f9b-eac0-4a7a-8614-d27ff1d446ba tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:29.273576 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-76052f9b-eac0-4a7a-8614-d27ff1d446ba tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:29.281449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-76052f9b-eac0-4a7a-8614-d27ff1d446ba tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.177330 Jul 14 12:19:29.282013 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 92/190] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:29 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:29.754563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d464e712-e08f-4383-9558-6900b96cc728 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:29.755245 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d464e712-e08f-4383-9558-6900b96cc728 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:29.764491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d464e712-e08f-4383-9558-6900b96cc728 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:29.764951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d464e712-e08f-4383-9558-6900b96cc728 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:29.765758 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d464e712-e08f-4383-9558-6900b96cc728 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:29.766198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d464e712-e08f-4383-9558-6900b96cc728 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:29.923903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d464e712-e08f-4383-9558-6900b96cc728 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:29.932597 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d464e712-e08f-4383-9558-6900b96cc728 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.181847 Jul 14 12:19:29.933741 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 99/191] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:29 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:30.194373 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b44887d8-cd20-407b-a61d-2d38e0b6d7c1 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:30.196114 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b44887d8-cd20-407b-a61d-2d38e0b6d7c1 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:30.204513 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b44887d8-cd20-407b-a61d-2d38e0b6d7c1 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:30.205166 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b44887d8-cd20-407b-a61d-2d38e0b6d7c1 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:30.207365 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b44887d8-cd20-407b-a61d-2d38e0b6d7c1 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:30.212110 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b44887d8-cd20-407b-a61d-2d38e0b6d7c1 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:30.237523 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b44887d8-cd20-407b-a61d-2d38e0b6d7c1 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Going to try to terminate instance {{(pid=118263) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:19:30.298792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3626d9e4-6835-4018-a76e-f2ccb4d73c18 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:30.299415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3626d9e4-6835-4018-a76e-f2ccb4d73c18 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:30.305314 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3626d9e4-6835-4018-a76e-f2ccb4d73c18 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:30.305765 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3626d9e4-6835-4018-a76e-f2ccb4d73c18 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:30.306520 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3626d9e4-6835-4018-a76e-f2ccb4d73c18 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:30.306990 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3626d9e4-6835-4018-a76e-f2ccb4d73c18 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:30.437547 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3626d9e4-6835-4018-a76e-f2ccb4d73c18 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:30.441006 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:30.445232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3626d9e4-6835-4018-a76e-f2ccb4d73c18 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.150390 Jul 14 12:19:30.451516 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 100/192] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:30 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:30.577437 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b44887d8-cd20-407b-a61d-2d38e0b6d7c1 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 204 len: 0 microversion: 2.1 time: 0.387068 Jul 14 12:19:30.577969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 93/193] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:19:30 2022] DELETE /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:19:30.586428 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-95575618-df27-4a02-8592-3a488d048aa0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:30.587127 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-95575618-df27-4a02-8592-3a488d048aa0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:30.593965 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-95575618-df27-4a02-8592-3a488d048aa0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:30.594421 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-95575618-df27-4a02-8592-3a488d048aa0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:30.595231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-95575618-df27-4a02-8592-3a488d048aa0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:30.595663 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-95575618-df27-4a02-8592-3a488d048aa0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:30.738608 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-95575618-df27-4a02-8592-3a488d048aa0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:30.746653 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-95575618-df27-4a02-8592-3a488d048aa0 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1554 microversion: 2.1 time: 0.163430 Jul 14 12:19:30.747271 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 101/194] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:30 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:31.021268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-36daeb7e-6e7b-4a2a-bfbd-75852ef9a5e4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:31.021268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-36daeb7e-6e7b-4a2a-bfbd-75852ef9a5e4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:31.021268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-36daeb7e-6e7b-4a2a-bfbd-75852ef9a5e4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:31.021268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-36daeb7e-6e7b-4a2a-bfbd-75852ef9a5e4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:31.021671 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-36daeb7e-6e7b-4a2a-bfbd-75852ef9a5e4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:31.021671 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-36daeb7e-6e7b-4a2a-bfbd-75852ef9a5e4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:31.105535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-36daeb7e-6e7b-4a2a-bfbd-75852ef9a5e4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:31.109274 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:31.117555 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-36daeb7e-6e7b-4a2a-bfbd-75852ef9a5e4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.157952 Jul 14 12:19:31.117555 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 94/195] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:30 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:31.423076 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-19dfb375-4afa-4a5c-bbd4-ce86a74b2346 req-b39bc161-eb54-4486-ad55-7f8ac42fe9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1629fa-7e62-4b9d-9b3f-5781ca63efb3", "name": "network-vif-plugged", "status": "completed", "tag": "327eab00-b490-4f1e-b8ec-760ae8cb63af"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:31.433880 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-19dfb375-4afa-4a5c-bbd4-ce86a74b2346 req-b39bc161-eb54-4486-ad55-7f8ac42fe9e0 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:31.434581 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-19dfb375-4afa-4a5c-bbd4-ce86a74b2346 req-b39bc161-eb54-4486-ad55-7f8ac42fe9e0 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:31.446390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-19dfb375-4afa-4a5c-bbd4-ce86a74b2346 req-b39bc161-eb54-4486-ad55-7f8ac42fe9e0 service nova] Creating event network-vif-plugged:327eab00-b490-4f1e-b8ec-760ae8cb63af for instance ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 on hv-cinder-84890 Jul 14 12:19:31.453470 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-19dfb375-4afa-4a5c-bbd4-ce86a74b2346 req-b39bc161-eb54-4486-ad55-7f8ac42fe9e0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034355 Jul 14 12:19:31.454347 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 102/196] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:19:31.463697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9fcc3c21-1b5b-4675-98d9-0b2b60ce424c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:31.465687 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9fcc3c21-1b5b-4675-98d9-0b2b60ce424c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:31.473360 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9fcc3c21-1b5b-4675-98d9-0b2b60ce424c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:31.474670 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9fcc3c21-1b5b-4675-98d9-0b2b60ce424c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:31.475675 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9fcc3c21-1b5b-4675-98d9-0b2b60ce424c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:31.476266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9fcc3c21-1b5b-4675-98d9-0b2b60ce424c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:31.617592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9fcc3c21-1b5b-4675-98d9-0b2b60ce424c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:31.628588 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9fcc3c21-1b5b-4675-98d9-0b2b60ce424c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.170685 Jul 14 12:19:31.629336 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 95/197] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:31 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:31.764846 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c0d5c55d-7a3d-4511-806e-3fbcabd65d90 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:31.765695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c0d5c55d-7a3d-4511-806e-3fbcabd65d90 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:31.771712 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c0d5c55d-7a3d-4511-806e-3fbcabd65d90 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:31.772249 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c0d5c55d-7a3d-4511-806e-3fbcabd65d90 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:31.773021 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c0d5c55d-7a3d-4511-806e-3fbcabd65d90 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:31.773454 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c0d5c55d-7a3d-4511-806e-3fbcabd65d90 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:31.911824 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c0d5c55d-7a3d-4511-806e-3fbcabd65d90 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:31.920740 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c0d5c55d-7a3d-4511-806e-3fbcabd65d90 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1554 microversion: 2.1 time: 0.160730 Jul 14 12:19:31.921313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 103/198] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:31 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:32.131187 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c41d1d02-9589-4b4e-929b-e110f575d3c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:32.131747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c41d1d02-9589-4b4e-929b-e110f575d3c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:32.139006 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c41d1d02-9589-4b4e-929b-e110f575d3c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:32.139457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c41d1d02-9589-4b4e-929b-e110f575d3c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:32.140289 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c41d1d02-9589-4b4e-929b-e110f575d3c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:32.140722 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c41d1d02-9589-4b4e-929b-e110f575d3c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:32.274001 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c41d1d02-9589-4b4e-929b-e110f575d3c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:32.282084 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c41d1d02-9589-4b4e-929b-e110f575d3c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.154983 Jul 14 12:19:32.282659 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 96/199] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:32 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:32.647529 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-04a18171-7953-4663-a27b-124eb9f2c7ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:32.648198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-04a18171-7953-4663-a27b-124eb9f2c7ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:32.654735 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04a18171-7953-4663-a27b-124eb9f2c7ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:32.655232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04a18171-7953-4663-a27b-124eb9f2c7ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:32.656165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04a18171-7953-4663-a27b-124eb9f2c7ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:32.656608 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04a18171-7953-4663-a27b-124eb9f2c7ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:32.840311 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-04a18171-7953-4663-a27b-124eb9f2c7ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:32.859490 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-04a18171-7953-4663-a27b-124eb9f2c7ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.207302 Jul 14 12:19:32.859490 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 104/200] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:32 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:32.938002 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-49ccb688-0ad3-4325-ad7a-c508aae3674f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:32.939259 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-49ccb688-0ad3-4325-ad7a-c508aae3674f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:32.946162 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-49ccb688-0ad3-4325-ad7a-c508aae3674f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:32.946691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-49ccb688-0ad3-4325-ad7a-c508aae3674f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:32.947963 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-49ccb688-0ad3-4325-ad7a-c508aae3674f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:32.949277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-49ccb688-0ad3-4325-ad7a-c508aae3674f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:33.144755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-49ccb688-0ad3-4325-ad7a-c508aae3674f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:33.155074 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-49ccb688-0ad3-4325-ad7a-c508aae3674f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1554 microversion: 2.1 time: 0.220953 Jul 14 12:19:33.163906 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 97/201] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:32 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1554 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:33.299511 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-59bdf340-57cd-4bbf-89db-287e7f62a348 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:33.302553 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-59bdf340-57cd-4bbf-89db-287e7f62a348 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:33.311907 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-59bdf340-57cd-4bbf-89db-287e7f62a348 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:33.313854 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-59bdf340-57cd-4bbf-89db-287e7f62a348 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:33.313854 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-59bdf340-57cd-4bbf-89db-287e7f62a348 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:33.313854 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-59bdf340-57cd-4bbf-89db-287e7f62a348 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:33.528602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-59bdf340-57cd-4bbf-89db-287e7f62a348 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:33.536517 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-59bdf340-57cd-4bbf-89db-287e7f62a348 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.241007 Jul 14 12:19:33.537092 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 105/202] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:33 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:33.867583 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-41f3061c-f513-4407-8781-47fbf34a9e79 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:33.868199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-41f3061c-f513-4407-8781-47fbf34a9e79 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:33.875115 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41f3061c-f513-4407-8781-47fbf34a9e79 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:33.880877 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41f3061c-f513-4407-8781-47fbf34a9e79 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:33.880877 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41f3061c-f513-4407-8781-47fbf34a9e79 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:33.880877 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41f3061c-f513-4407-8781-47fbf34a9e79 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:34.131644 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-3f60232d-93ce-4589-97ca-f48e8868bd8e req-8db8994d-cacf-4390-bcc1-8c5263126127 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7f193e-2bb2-42ac-a92a-e23f4fb316cb", "name": "network-vif-deleted", "tag": "c4de4bd3-dc7b-4a40-a881-cdce6997d4fa"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:34.147525 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-41f3061c-f513-4407-8781-47fbf34a9e79 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:34.148077 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-3f60232d-93ce-4589-97ca-f48e8868bd8e req-8db8994d-cacf-4390-bcc1-8c5263126127 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:34.148581 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-3f60232d-93ce-4589-97ca-f48e8868bd8e req-8db8994d-cacf-4390-bcc1-8c5263126127 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:34.156875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-41f3061c-f513-4407-8781-47fbf34a9e79 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.293004 Jul 14 12:19:34.157468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 98/203] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:33 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:34.163948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-3f60232d-93ce-4589-97ca-f48e8868bd8e req-8db8994d-cacf-4390-bcc1-8c5263126127 service nova] Creating event network-vif-deleted:c4de4bd3-dc7b-4a40-a881-cdce6997d4fa for instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb on hv-cinder-84890 Jul 14 12:19:34.173228 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b83866da-0e24-466d-ae13-ac9cece2282f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:34.174231 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b83866da-0e24-466d-ae13-ac9cece2282f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:34.178671 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-3f60232d-93ce-4589-97ca-f48e8868bd8e req-8db8994d-cacf-4390-bcc1-8c5263126127 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051573 Jul 14 12:19:34.182158 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83866da-0e24-466d-ae13-ac9cece2282f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:34.183177 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83866da-0e24-466d-ae13-ac9cece2282f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:34.184296 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83866da-0e24-466d-ae13-ac9cece2282f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:34.185189 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83866da-0e24-466d-ae13-ac9cece2282f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:34.185803 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 106/204] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:19:34.264006 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b83866da-0e24-466d-ae13-ac9cece2282f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:34.272597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b83866da-0e24-466d-ae13-ac9cece2282f tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1512 microversion: 2.1 time: 0.103724 Jul 14 12:19:34.273975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 99/205] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:34 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1512 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:34.554149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-920545f4-fb79-492a-9f0b-0dc4f7f367cb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:34.554871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-920545f4-fb79-492a-9f0b-0dc4f7f367cb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:34.561574 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-920545f4-fb79-492a-9f0b-0dc4f7f367cb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:34.562027 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-920545f4-fb79-492a-9f0b-0dc4f7f367cb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:34.562829 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-920545f4-fb79-492a-9f0b-0dc4f7f367cb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:34.563275 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-920545f4-fb79-492a-9f0b-0dc4f7f367cb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:34.709431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-920545f4-fb79-492a-9f0b-0dc4f7f367cb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:34.717728 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-920545f4-fb79-492a-9f0b-0dc4f7f367cb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.167736 Jul 14 12:19:34.720139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 107/206] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:34 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:35.176885 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7be8fc14-f986-4b44-b7be-d3c1e7ba8502 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:35.177797 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7be8fc14-f986-4b44-b7be-d3c1e7ba8502 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:35.188075 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7be8fc14-f986-4b44-b7be-d3c1e7ba8502 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:35.188932 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7be8fc14-f986-4b44-b7be-d3c1e7ba8502 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:35.190275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7be8fc14-f986-4b44-b7be-d3c1e7ba8502 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:35.191063 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7be8fc14-f986-4b44-b7be-d3c1e7ba8502 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:35.295228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:35.296561 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:35.303828 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:35.304498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:35.306467 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:35.306467 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:35.359171 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:35.359614 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:35.360058 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lazy-loading 'fault' on Instance uuid 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:19:35.408482 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7be8fc14-f986-4b44-b7be-d3c1e7ba8502 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:35.416169 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7be8fc14-f986-4b44-b7be-d3c1e7ba8502 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1314 microversion: 2.1 time: 0.245561 Jul 14 12:19:35.427407 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 100/207] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:35 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:35.429797 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0a6364a4a884b09b5eb80897c19e296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1500083e98d84701b246fbbd749354fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:35.440110 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-566237b7-02e9-4f5a-8b75-4f1bbe0aa30d tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 200 len: 1350 microversion: 2.1 time: 0.153872 Jul 14 12:19:35.440749 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 108/208] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:35 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 1350 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:35.735415 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-6e354df8-4b67-4946-a240-3ebf5b7bd6d9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:35.737813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-6e354df8-4b67-4946-a240-3ebf5b7bd6d9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:35.742026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6e354df8-4b67-4946-a240-3ebf5b7bd6d9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:35.742477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6e354df8-4b67-4946-a240-3ebf5b7bd6d9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:35.743268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6e354df8-4b67-4946-a240-3ebf5b7bd6d9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:35.743705 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6e354df8-4b67-4946-a240-3ebf5b7bd6d9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:35.916518 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6e354df8-4b67-4946-a240-3ebf5b7bd6d9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:35.930970 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-6e354df8-4b67-4946-a240-3ebf5b7bd6d9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.198839 Jul 14 12:19:35.932280 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 101/209] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:35 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:36.435815 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e9ae4ea0-3e24-4e7f-a256-f6720000f7af tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:36.437038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e9ae4ea0-3e24-4e7f-a256-f6720000f7af tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:36.444002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9ae4ea0-3e24-4e7f-a256-f6720000f7af tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:36.444469 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9ae4ea0-3e24-4e7f-a256-f6720000f7af tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:36.445235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9ae4ea0-3e24-4e7f-a256-f6720000f7af tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:36.445697 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9ae4ea0-3e24-4e7f-a256-f6720000f7af tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:36.459968 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8c86542d-447a-4a74-981d-1635a25ee535 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:36.460630 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8c86542d-447a-4a74-981d-1635a25ee535 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:36.472874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c86542d-447a-4a74-981d-1635a25ee535 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:36.473321 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c86542d-447a-4a74-981d-1635a25ee535 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:36.474090 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c86542d-447a-4a74-981d-1635a25ee535 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:36.474525 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c86542d-447a-4a74-981d-1635a25ee535 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:36.497263 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-8c86542d-447a-4a74-981d-1635a25ee535 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] HTTP exception thrown: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8c86542d-447a-4a74-981d-1635a25ee535 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Request method failure captured: Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb HTTP/1.1 Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmW5xhihhz3DNzmFjoqHT4143vh9zKf6MGI1gLIVRIhbIVHMc3vDyZeJ8P21H9jjktLCHVev29ZFOOcMWcjba2MVtNQpvGfTrPRrBn19CdImnVeFMP79GYVYycqrRV6-Ozg626ScVAzLgNfuamABzSd9HymSzOwHTbaTzzG-nIb4Uk Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 1500083e98d84701b246fbbd749354fa Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:19:36.503258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1500083e98d84701b246fbbd749354fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1500083e98d84701b246fbbd749354fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1500083e98d84701b246fbbd749354fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1500083e98d84701b246fbbd749354fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 1500083e98d84701b246fbbd749354fa Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-DeleteServersTestJSON-1150561-project Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: a0a6364a4a884b09b5eb80897c19e296 Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-DeleteServersTestJSON-1150561-project Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:36.504556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '9b7f193e-2bb2-42ac-a92a-e23f4fb316cb'} Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:19:36.505323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:36.506409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:36.507404 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8c86542d-447a-4a74-981d-1635a25ee535 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Returning 404 to user: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:19:36.512327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8c86542d-447a-4a74-981d-1635a25ee535 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 404 len: 111 microversion: 2.1 time: 0.056067 Jul 14 12:19:36.513139 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 102/210] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:36 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:19:36.599742 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e9ae4ea0-3e24-4e7f-a256-f6720000f7af tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:36.608006 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e9ae4ea0-3e24-4e7f-a256-f6720000f7af tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1497 microversion: 2.1 time: 0.177282 Jul 14 12:19:36.618790 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 109/211] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:36 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:36.705533 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f5fcfccd-901a-4362-9ce5-1fea9e0cc2ba tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:36.707797 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f5fcfccd-901a-4362-9ce5-1fea9e0cc2ba tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:36.721941 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f5fcfccd-901a-4362-9ce5-1fea9e0cc2ba tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:36.722397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f5fcfccd-901a-4362-9ce5-1fea9e0cc2ba tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:36.729830 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f5fcfccd-901a-4362-9ce5-1fea9e0cc2ba tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:36.730657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f5fcfccd-901a-4362-9ce5-1fea9e0cc2ba tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:36.749007 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-f5fcfccd-901a-4362-9ce5-1fea9e0cc2ba tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] HTTP exception thrown: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f5fcfccd-901a-4362-9ce5-1fea9e0cc2ba tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Request method failure captured: Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb/os-volume_attachments HTTP/1.1 Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmW5xhihhz3DNzmFjoqHT4143vh9zKf6MGI1gLIVRIhbIVHMc3vDyZeJ8P21H9jjktLCHVev29ZFOOcMWcjba2MVtNQpvGfTrPRrBn19CdImnVeFMP79GYVYycqrRV6-Ozg626ScVAzLgNfuamABzSd9HymSzOwHTbaTzzG-nIb4Uk Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 1500083e98d84701b246fbbd749354fa Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:19:36.750915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1500083e98d84701b246fbbd749354fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1500083e98d84701b246fbbd749354fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1500083e98d84701b246fbbd749354fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1500083e98d84701b246fbbd749354fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 1500083e98d84701b246fbbd749354fa Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-DeleteServersTestJSON-1150561-project Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: a0a6364a4a884b09b5eb80897c19e296 Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-DeleteServersTestJSON-1150561-project Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:36.752131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'server_id': '9b7f193e-2bb2-42ac-a92a-e23f4fb316cb'} Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:19:36.752766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:36.753870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:36.755004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f5fcfccd-901a-4362-9ce5-1fea9e0cc2ba tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Returning 404 to user: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:19:36.755004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f5fcfccd-901a-4362-9ce5-1fea9e0cc2ba tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.051612 Jul 14 12:19:36.755004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 103/212] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:19:36 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb/os-volume_attachments => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:19:36.949473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-baa1b19c-4b91-443c-84be-e0efc3daf286 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:36.950185 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-baa1b19c-4b91-443c-84be-e0efc3daf286 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:36.956303 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-baa1b19c-4b91-443c-84be-e0efc3daf286 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:36.956756 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-baa1b19c-4b91-443c-84be-e0efc3daf286 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:36.957565 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-baa1b19c-4b91-443c-84be-e0efc3daf286 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:36.958002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-baa1b19c-4b91-443c-84be-e0efc3daf286 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:37.085705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-baa1b19c-4b91-443c-84be-e0efc3daf286 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:37.093476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-baa1b19c-4b91-443c-84be-e0efc3daf286 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.148521 Jul 14 12:19:37.098663 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 110/213] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:36 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:38.110248 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-68620b10-158e-4f80-8899-b4ea24b9f9bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:38.110904 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-68620b10-158e-4f80-8899-b4ea24b9f9bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:38.121297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-68620b10-158e-4f80-8899-b4ea24b9f9bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:38.121297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-68620b10-158e-4f80-8899-b4ea24b9f9bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:38.121297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-68620b10-158e-4f80-8899-b4ea24b9f9bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:38.121297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-68620b10-158e-4f80-8899-b4ea24b9f9bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:38.223508 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8fe63fdc-bab3-429b-a89f-32c2c6cc363e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:38.224583 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8fe63fdc-bab3-429b-a89f-32c2c6cc363e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:38.232919 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8fe63fdc-bab3-429b-a89f-32c2c6cc363e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:38.233362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8fe63fdc-bab3-429b-a89f-32c2c6cc363e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:38.234130 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8fe63fdc-bab3-429b-a89f-32c2c6cc363e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:38.234566 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8fe63fdc-bab3-429b-a89f-32c2c6cc363e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:38.255661 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-68620b10-158e-4f80-8899-b4ea24b9f9bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:38.259897 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8fe63fdc-bab3-429b-a89f-32c2c6cc363e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:19:38.263749 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-68620b10-158e-4f80-8899-b4ea24b9f9bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.157646 Jul 14 12:19:38.264325 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 104/214] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:38 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:38.520159 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8fe63fdc-bab3-429b-a89f-32c2c6cc363e tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 204 len: 0 microversion: 2.1 time: 0.300158 Jul 14 12:19:38.520904 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 111/215] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:19:38 2022] DELETE /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 12:19:38.529317 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3dd38401-3b19-45dc-a8ba-4e396ec02ea5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:38.530007 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3dd38401-3b19-45dc-a8ba-4e396ec02ea5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:38.536204 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3dd38401-3b19-45dc-a8ba-4e396ec02ea5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:38.536651 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3dd38401-3b19-45dc-a8ba-4e396ec02ea5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:38.537427 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3dd38401-3b19-45dc-a8ba-4e396ec02ea5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:38.537855 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3dd38401-3b19-45dc-a8ba-4e396ec02ea5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:38.673819 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3dd38401-3b19-45dc-a8ba-4e396ec02ea5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:38.680354 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3dd38401-3b19-45dc-a8ba-4e396ec02ea5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1503 microversion: 2.1 time: 0.155410 Jul 14 12:19:38.682806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 105/216] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:38 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:38.697540 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d888a862-10ea-4fb0-bdf1-21b202d22a87 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:38.704631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d888a862-10ea-4fb0-bdf1-21b202d22a87 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:38.705405 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d888a862-10ea-4fb0-bdf1-21b202d22a87 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:38.705405 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d888a862-10ea-4fb0-bdf1-21b202d22a87 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:38.706126 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d888a862-10ea-4fb0-bdf1-21b202d22a87 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:38.706570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d888a862-10ea-4fb0-bdf1-21b202d22a87 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:38.724122 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-d888a862-10ea-4fb0-bdf1-21b202d22a87 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] HTTP exception thrown: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d888a862-10ea-4fb0-bdf1-21b202d22a87 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Request method failure captured: Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: DELETE /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb HTTP/1.1 Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AmW5xhihhz3DNzmFjoqHT4143vh9zKf6MGI1gLIVRIhbIVHMc3vDyZeJ8P21H9jjktLCHVev29ZFOOcMWcjba2MVtNQpvGfTrPRrBn19CdImnVeFMP79GYVYycqrRV6-Ozg626ScVAzLgNfuamABzSd9HymSzOwHTbaTzzG-nIb4Uk Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 1500083e98d84701b246fbbd749354fa Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:19:38.729034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1500083e98d84701b246fbbd749354fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1500083e98d84701b246fbbd749354fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1500083e98d84701b246fbbd749354fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1500083e98d84701b246fbbd749354fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 1500083e98d84701b246fbbd749354fa Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-DeleteServersTestJSON-1150561-project Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: a0a6364a4a884b09b5eb80897c19e296 Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-DeleteServersTestJSON-1150561-project Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:38.730556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '9b7f193e-2bb2-42ac-a92a-e23f4fb316cb'} Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:19:38.731362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:38.732504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:19:38.733606 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d888a862-10ea-4fb0-bdf1-21b202d22a87 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Returning 404 to user: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:19:38.733606 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d888a862-10ea-4fb0-bdf1-21b202d22a87 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 404 len: 111 microversion: 2.1 time: 0.037226 Jul 14 12:19:38.733606 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 112/217] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:19:38 2022] DELETE /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:19:38.739839 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c17c3285-269b-48ae-8e05-606c7cba0f88 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:38.740497 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c17c3285-269b-48ae-8e05-606c7cba0f88 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] [instance: 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:38.746791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c17c3285-269b-48ae-8e05-606c7cba0f88 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:38.747254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c17c3285-269b-48ae-8e05-606c7cba0f88 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:38.748082 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c17c3285-269b-48ae-8e05-606c7cba0f88 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:38.748518 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c17c3285-269b-48ae-8e05-606c7cba0f88 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:38.762437 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-c17c3285-269b-48ae-8e05-606c7cba0f88 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] HTTP exception thrown: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c17c3285-269b-48ae-8e05-606c7cba0f88 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Request method failure captured: Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb HTTP/1.1 Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmW5xhihhz3DNzmFjoqHT4143vh9zKf6MGI1gLIVRIhbIVHMc3vDyZeJ8P21H9jjktLCHVev29ZFOOcMWcjba2MVtNQpvGfTrPRrBn19CdImnVeFMP79GYVYycqrRV6-Ozg626ScVAzLgNfuamABzSd9HymSzOwHTbaTzzG-nIb4Uk Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 1500083e98d84701b246fbbd749354fa Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:19:38.763980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_1500083e98d84701b246fbbd749354fa", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/1500083e98d84701b246fbbd749354fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1500083e98d84701b246fbbd749354fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/1500083e98d84701b246fbbd749354fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 1500083e98d84701b246fbbd749354fa Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-DeleteServersTestJSON-1150561 Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-DeleteServersTestJSON-1150561-project Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: a0a6364a4a884b09b5eb80897c19e296 Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-DeleteServersTestJSON-1150561-project Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:38.765790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '9b7f193e-2bb2-42ac-a92a-e23f4fb316cb'} Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:19:38.766455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. Jul 14 12:19:38.767594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:19:38.768742 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c17c3285-269b-48ae-8e05-606c7cba0f88 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] Returning 404 to user: Instance 9b7f193e-2bb2-42ac-a92a-e23f4fb316cb could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:19:38.768742 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c17c3285-269b-48ae-8e05-606c7cba0f88 tempest-DeleteServersTestJSON-1150561 tempest-DeleteServersTestJSON-1150561-project] 10.222.0.27 "GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb" status: 404 len: 111 microversion: 2.1 time: 0.029421 Jul 14 12:19:38.768742 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 106/218] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:38 2022] GET /compute/v2.1/servers/9b7f193e-2bb2-42ac-a92a-e23f4fb316cb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:19:39.280539 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f7fac940-5f16-4183-9b40-65c2f0d6fc63 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:39.281172 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f7fac940-5f16-4183-9b40-65c2f0d6fc63 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:39.287174 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f7fac940-5f16-4183-9b40-65c2f0d6fc63 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:39.287627 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f7fac940-5f16-4183-9b40-65c2f0d6fc63 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:39.288394 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f7fac940-5f16-4183-9b40-65c2f0d6fc63 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:39.289031 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f7fac940-5f16-4183-9b40-65c2f0d6fc63 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:39.430399 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f7fac940-5f16-4183-9b40-65c2f0d6fc63 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:39.451450 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f7fac940-5f16-4183-9b40-65c2f0d6fc63 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.164069 Jul 14 12:19:39.451450 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 113/219] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:39 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:39.698118 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-25cb5026-3ebf-4b97-8ccb-c9afddab0b29 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:39.699531 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-25cb5026-3ebf-4b97-8ccb-c9afddab0b29 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:39.706371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25cb5026-3ebf-4b97-8ccb-c9afddab0b29 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:39.706857 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25cb5026-3ebf-4b97-8ccb-c9afddab0b29 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:39.707627 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25cb5026-3ebf-4b97-8ccb-c9afddab0b29 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:39.708064 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25cb5026-3ebf-4b97-8ccb-c9afddab0b29 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:39.926906 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-25cb5026-3ebf-4b97-8ccb-c9afddab0b29 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:39.935086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-25cb5026-3ebf-4b97-8ccb-c9afddab0b29 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1503 microversion: 2.1 time: 0.240876 Jul 14 12:19:39.935703 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 107/220] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:39 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1503 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:40.462941 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b07ffea2-21de-4d2f-a210-eee26d01e60b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:40.463655 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b07ffea2-21de-4d2f-a210-eee26d01e60b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:40.470212 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b07ffea2-21de-4d2f-a210-eee26d01e60b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:40.470754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b07ffea2-21de-4d2f-a210-eee26d01e60b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:40.471767 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b07ffea2-21de-4d2f-a210-eee26d01e60b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:40.472291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b07ffea2-21de-4d2f-a210-eee26d01e60b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:40.615623 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b07ffea2-21de-4d2f-a210-eee26d01e60b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:40.624820 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b07ffea2-21de-4d2f-a210-eee26d01e60b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.165828 Jul 14 12:19:40.625401 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 114/221] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:40 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:40.953611 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-21680b0a-e5e1-4b9b-b1cd-1cc972f07936 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:40.955012 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-21680b0a-e5e1-4b9b-b1cd-1cc972f07936 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:40.963034 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-21680b0a-e5e1-4b9b-b1cd-1cc972f07936 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:40.963817 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-21680b0a-e5e1-4b9b-b1cd-1cc972f07936 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:40.965863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-21680b0a-e5e1-4b9b-b1cd-1cc972f07936 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:40.966277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-21680b0a-e5e1-4b9b-b1cd-1cc972f07936 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:41.218408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-21680b0a-e5e1-4b9b-b1cd-1cc972f07936 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:41.245593 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-21680b0a-e5e1-4b9b-b1cd-1cc972f07936 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1503 microversion: 2.1 time: 0.296675 Jul 14 12:19:41.246607 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 108/222] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:40 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1503 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:41.362710 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-1e009f51-bf99-40c9-9db1-fa49a2a054c6 req-ee05f676-4d67-474b-bfd7-f9bc93db0110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1629fa-7e62-4b9d-9b3f-5781ca63efb3", "name": "network-vif-deleted", "tag": "327eab00-b490-4f1e-b8ec-760ae8cb63af"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:41.373922 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-1e009f51-bf99-40c9-9db1-fa49a2a054c6 req-ee05f676-4d67-474b-bfd7-f9bc93db0110 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:41.374619 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-1e009f51-bf99-40c9-9db1-fa49a2a054c6 req-ee05f676-4d67-474b-bfd7-f9bc93db0110 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:41.392515 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-1e009f51-bf99-40c9-9db1-fa49a2a054c6 req-ee05f676-4d67-474b-bfd7-f9bc93db0110 service nova] Creating event network-vif-deleted:327eab00-b490-4f1e-b8ec-760ae8cb63af for instance ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 on hv-cinder-84890 Jul 14 12:19:41.406029 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-1e009f51-bf99-40c9-9db1-fa49a2a054c6 req-ee05f676-4d67-474b-bfd7-f9bc93db0110 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047760 Jul 14 12:19:41.412228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 115/223] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:19:41.643922 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-90778853-9747-4722-9285-209ba459830e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:41.644945 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-90778853-9747-4722-9285-209ba459830e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:41.653485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-90778853-9747-4722-9285-209ba459830e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:41.653485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-90778853-9747-4722-9285-209ba459830e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:41.653485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-90778853-9747-4722-9285-209ba459830e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:41.653485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-90778853-9747-4722-9285-209ba459830e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:41.809143 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-90778853-9747-4722-9285-209ba459830e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:41.817530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-90778853-9747-4722-9285-209ba459830e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.179211 Jul 14 12:19:41.818319 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 109/224] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:41 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:42.264236 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:42.264921 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:42.271481 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:42.271929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:42.272875 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:42.273312 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:42.308937 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:42.312457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:42.312457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lazy-loading 'fault' on Instance uuid ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:19:42.381978 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:42.391294 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-509b4042-4ded-4cf1-9b8f-4b90fa746b7b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 200 len: 1304 microversion: 2.1 time: 0.131153 Jul 14 12:19:42.392009 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 116/225] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:42 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:42.834869 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f4702dc6-84af-4147-931c-a88db9378b82 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:42.836104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f4702dc6-84af-4147-931c-a88db9378b82 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:42.850100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f4702dc6-84af-4147-931c-a88db9378b82 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:42.850550 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f4702dc6-84af-4147-931c-a88db9378b82 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:42.851567 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f4702dc6-84af-4147-931c-a88db9378b82 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:42.851794 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f4702dc6-84af-4147-931c-a88db9378b82 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:43.078638 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f4702dc6-84af-4147-931c-a88db9378b82 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:43.088787 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f4702dc6-84af-4147-931c-a88db9378b82 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.257826 Jul 14 12:19:43.096318 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 110/226] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:42 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:43.411036 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fae4339a-9e5d-41f7-ab93-f61c436b5a47 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:43.411643 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fae4339a-9e5d-41f7-ab93-f61c436b5a47 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: ea1629fa-7e62-4b9d-9b3f-5781ca63efb3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:43.425545 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fae4339a-9e5d-41f7-ab93-f61c436b5a47 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:43.427756 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fae4339a-9e5d-41f7-ab93-f61c436b5a47 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:43.427756 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fae4339a-9e5d-41f7-ab93-f61c436b5a47 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:43.427756 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fae4339a-9e5d-41f7-ab93-f61c436b5a47 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:43.447342 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-fae4339a-9e5d-41f7-ab93-f61c436b5a47 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] HTTP exception thrown: Instance ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 could not be found. Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fae4339a-9e5d-41f7-ab93-f61c436b5a47 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Request method failure captured: Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 HTTP/1.1 Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Am4gqz6xbbMzca82VQ1kPbdsI4yrS_05HHmfinRyNhNNKkyv2KR-0Cu83fVY17ERTdjo2WNx13L-UFzp1vZkrO3ueVPEwVcrYdQVAg_z2MT0UATeYK84mpUsfU1Y5LtqCOSE6JZ2XFVrcBd8PtH_kpmmzBhaVy1UaCSNMftpTd3nYo Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 8bf2b73c991f489d915d7124b5d24564 Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-VolumesActionsTest-1321194053 Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:19:43.462349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8bf2b73c991f489d915d7124b5d24564", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8bf2b73c991f489d915d7124b5d24564"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bf2b73c991f489d915d7124b5d24564"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bf2b73c991f489d915d7124b5d24564"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-VolumesActionsTest-1321194053 Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 8bf2b73c991f489d915d7124b5d24564 Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-VolumesActionsTest-1321194053 Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-VolumesActionsTest-1321194053-project Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 3ccee18a56e44ccebfa14d264deb219b Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-VolumesActionsTest-1321194053-project Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 could not be found. Jul 14 12:19:43.464903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'ea1629fa-7e62-4b9d-9b3f-5781ca63efb3'} Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 could not be found. Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:19:43.465702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 could not be found. Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 could not be found. Jul 14 12:19:43.466913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:19:43.467893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fae4339a-9e5d-41f7-ab93-f61c436b5a47 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Returning 404 to user: Instance ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:19:43.467893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fae4339a-9e5d-41f7-ab93-f61c436b5a47 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3" status: 404 len: 111 microversion: 2.1 time: 0.043538 Jul 14 12:19:43.467893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 117/227] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:43 2022] GET /compute/v2.1/servers/ea1629fa-7e62-4b9d-9b3f-5781ca63efb3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:19:43.561120 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1543666691", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "networks": [{"uuid": "c7c0701d-ea07-40d2-a551-c26bc0c8851b"}]}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:43.616085 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] validate_networks() for [('c7c0701d-ea07-40d2-a551-c26bc0c8851b', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:19:44.114246 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-bee70aaa-9354-4cff-a114-56ab3ab3fbb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:44.115247 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-bee70aaa-9354-4cff-a114-56ab3ab3fbb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:44.139632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bee70aaa-9354-4cff-a114-56ab3ab3fbb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:44.143114 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bee70aaa-9354-4cff-a114-56ab3ab3fbb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:44.149674 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bee70aaa-9354-4cff-a114-56ab3ab3fbb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:44.152438 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bee70aaa-9354-4cff-a114-56ab3ab3fbb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:44.203964 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:44.263664 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:19:44.264154 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:19:44.264541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:19:44.264946 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:19:44.265595 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:19:44.276169 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:44.277280 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:44.278615 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:44.279087 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:44.301023 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Getting quotas for project 8bf2b73c991f489d915d7124b5d24564. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:19:44.307874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Getting quotas for user 3ccee18a56e44ccebfa14d264deb219b and project 8bf2b73c991f489d915d7124b5d24564. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:19:44.325381 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:19:44.328662 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:19:44.351308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-bee70aaa-9354-4cff-a114-56ab3ab3fbb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:44.374689 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-bee70aaa-9354-4cff-a114-56ab3ab3fbb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.266379 Jul 14 12:19:44.381133 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 118/228] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:44 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:44.482165 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ffcb0390-bcb8-4163-bd5a-e5fc8a661785 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.925477 Jul 14 12:19:44.483096 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 111/229] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:19:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:19:44.494204 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-601c1a50-68b1-4e00-8bad-26aeb3f8ad1d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:44.494909 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-601c1a50-68b1-4e00-8bad-26aeb3f8ad1d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:44.577069 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-601c1a50-68b1-4e00-8bad-26aeb3f8ad1d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:44.594842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-601c1a50-68b1-4e00-8bad-26aeb3f8ad1d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1214 microversion: 2.1 time: 0.094473 Jul 14 12:19:44.594842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 119/230] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:44 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:45.393150 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3a23b926-5163-4158-a89b-ad6b1a605e22 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:45.393990 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3a23b926-5163-4158-a89b-ad6b1a605e22 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:45.400406 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3a23b926-5163-4158-a89b-ad6b1a605e22 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:45.400858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3a23b926-5163-4158-a89b-ad6b1a605e22 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:45.401747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3a23b926-5163-4158-a89b-ad6b1a605e22 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:45.402380 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3a23b926-5163-4158-a89b-ad6b1a605e22 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:45.543167 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3a23b926-5163-4158-a89b-ad6b1a605e22 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:45.551905 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3a23b926-5163-4158-a89b-ad6b1a605e22 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.163775 Jul 14 12:19:45.553970 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 112/231] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:45 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:45.602758 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3bebc167-a40f-4973-9270-93dcbf9b6da6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:45.603439 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3bebc167-a40f-4973-9270-93dcbf9b6da6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:45.623114 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3bebc167-a40f-4973-9270-93dcbf9b6da6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:45.623563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3bebc167-a40f-4973-9270-93dcbf9b6da6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:45.624433 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3bebc167-a40f-4973-9270-93dcbf9b6da6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:45.624869 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3bebc167-a40f-4973-9270-93dcbf9b6da6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:45.694148 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3bebc167-a40f-4973-9270-93dcbf9b6da6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:45.703206 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3bebc167-a40f-4973-9270-93dcbf9b6da6 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1218 microversion: 2.1 time: 0.104582 Jul 14 12:19:45.703900 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 120/232] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:45 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:46.572432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a8f94383-90d6-4ca0-b342-a87b736effd6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:46.574414 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a8f94383-90d6-4ca0-b342-a87b736effd6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:46.584008 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8f94383-90d6-4ca0-b342-a87b736effd6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:46.584008 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8f94383-90d6-4ca0-b342-a87b736effd6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:46.584008 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8f94383-90d6-4ca0-b342-a87b736effd6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:46.584008 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8f94383-90d6-4ca0-b342-a87b736effd6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:46.730784 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-96c9fc2b-3c60-44fa-b9cf-9976cfeceba5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:46.730784 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-96c9fc2b-3c60-44fa-b9cf-9976cfeceba5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:46.733666 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-96c9fc2b-3c60-44fa-b9cf-9976cfeceba5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:46.734452 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-96c9fc2b-3c60-44fa-b9cf-9976cfeceba5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:46.735322 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-96c9fc2b-3c60-44fa-b9cf-9976cfeceba5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:46.735759 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-96c9fc2b-3c60-44fa-b9cf-9976cfeceba5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:46.797282 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a8f94383-90d6-4ca0-b342-a87b736effd6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:46.802019 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-96c9fc2b-3c60-44fa-b9cf-9976cfeceba5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:46.810120 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a8f94383-90d6-4ca0-b342-a87b736effd6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.241671 Jul 14 12:19:46.816921 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 113/233] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:46 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:46.817056 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-96c9fc2b-3c60-44fa-b9cf-9976cfeceba5 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1266 microversion: 2.1 time: 0.095221 Jul 14 12:19:46.817056 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 121/234] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:46 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:47.830563 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-fa64b5a9-4a8e-4d1f-b3ff-6fb797927364 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:47.832481 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-fa64b5a9-4a8e-4d1f-b3ff-6fb797927364 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:47.833555 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f2cf1981-2afd-46dd-b483-edd878654b3a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:47.834727 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f2cf1981-2afd-46dd-b483-edd878654b3a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:47.842634 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fa64b5a9-4a8e-4d1f-b3ff-6fb797927364 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:47.843136 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fa64b5a9-4a8e-4d1f-b3ff-6fb797927364 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:47.847432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fa64b5a9-4a8e-4d1f-b3ff-6fb797927364 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:47.847854 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f2cf1981-2afd-46dd-b483-edd878654b3a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:47.848411 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f2cf1981-2afd-46dd-b483-edd878654b3a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:47.848824 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fa64b5a9-4a8e-4d1f-b3ff-6fb797927364 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:47.850275 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f2cf1981-2afd-46dd-b483-edd878654b3a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:47.854108 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f2cf1981-2afd-46dd-b483-edd878654b3a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:47.860721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:48.021498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f2cf1981-2afd-46dd-b483-edd878654b3a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:48.034589 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f2cf1981-2afd-46dd-b483-edd878654b3a tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1272 microversion: 2.1 time: 0.208402 Jul 14 12:19:48.035583 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 122/235] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:47 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1272 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:48.156514 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-fa64b5a9-4a8e-4d1f-b3ff-6fb797927364 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:48.168647 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-fa64b5a9-4a8e-4d1f-b3ff-6fb797927364 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.345484 Jul 14 12:19:48.170388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 114/236] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:47 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:49.056852 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f79e0bd8-d672-4e17-a5ea-1b6656bf8ea1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:49.059971 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f79e0bd8-d672-4e17-a5ea-1b6656bf8ea1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:49.077293 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f79e0bd8-d672-4e17-a5ea-1b6656bf8ea1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:49.078088 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f79e0bd8-d672-4e17-a5ea-1b6656bf8ea1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:49.081948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f79e0bd8-d672-4e17-a5ea-1b6656bf8ea1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:49.081948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f79e0bd8-d672-4e17-a5ea-1b6656bf8ea1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:49.188545 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d262c5ad-2985-4ad8-9b48-8c6e65eb416c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:49.189322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d262c5ad-2985-4ad8-9b48-8c6e65eb416c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:49.196765 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d262c5ad-2985-4ad8-9b48-8c6e65eb416c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:49.197516 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d262c5ad-2985-4ad8-9b48-8c6e65eb416c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:49.198408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d262c5ad-2985-4ad8-9b48-8c6e65eb416c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:49.199006 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d262c5ad-2985-4ad8-9b48-8c6e65eb416c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:49.346004 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f79e0bd8-d672-4e17-a5ea-1b6656bf8ea1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:49.353661 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f79e0bd8-d672-4e17-a5ea-1b6656bf8ea1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1314 microversion: 2.1 time: 0.303301 Jul 14 12:19:49.356415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 123/237] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:49 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:49.501728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d262c5ad-2985-4ad8-9b48-8c6e65eb416c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:49.514630 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d262c5ad-2985-4ad8-9b48-8c6e65eb416c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.331630 Jul 14 12:19:49.515601 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 115/238] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:49 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:49.825750 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-2f5b32d5-67f2-48c1-a0ee-af695e3ef525 req-d678f411-d6bd-4894-b586-33482c36f336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc2d31b3-8a26-44d8-a55a-0435d3325df4", "tag": "e9341909-2ab9-4a65-9970-c79e8db5eafc"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:49.861032 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-2f5b32d5-67f2-48c1-a0ee-af695e3ef525 req-d678f411-d6bd-4894-b586-33482c36f336 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:49.863210 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-2f5b32d5-67f2-48c1-a0ee-af695e3ef525 req-d678f411-d6bd-4894-b586-33482c36f336 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:49.896758 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-2f5b32d5-67f2-48c1-a0ee-af695e3ef525 req-d678f411-d6bd-4894-b586-33482c36f336 service nova] Creating event network-changed:e9341909-2ab9-4a65-9970-c79e8db5eafc for instance dc2d31b3-8a26-44d8-a55a-0435d3325df4 on hv-cinder-84890 Jul 14 12:19:49.910986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-2f5b32d5-67f2-48c1-a0ee-af695e3ef525 req-d678f411-d6bd-4894-b586-33482c36f336 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089314 Jul 14 12:19:49.915424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 124/239] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:19:50.372804 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9f43b75b-76c7-46ac-99b5-98988500e6fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:50.374010 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9f43b75b-76c7-46ac-99b5-98988500e6fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:50.377242 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:50.393277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f43b75b-76c7-46ac-99b5-98988500e6fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:50.393277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f43b75b-76c7-46ac-99b5-98988500e6fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:50.393277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f43b75b-76c7-46ac-99b5-98988500e6fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:50.399609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f43b75b-76c7-46ac-99b5-98988500e6fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:50.533991 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8deb47c7-313d-46ab-8cdc-fe35f8f8eae3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:50.534776 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8deb47c7-313d-46ab-8cdc-fe35f8f8eae3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:50.549213 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8deb47c7-313d-46ab-8cdc-fe35f8f8eae3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:50.549667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8deb47c7-313d-46ab-8cdc-fe35f8f8eae3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:50.550453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8deb47c7-313d-46ab-8cdc-fe35f8f8eae3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:50.550916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8deb47c7-313d-46ab-8cdc-fe35f8f8eae3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:50.613872 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9f43b75b-76c7-46ac-99b5-98988500e6fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:50.625393 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9f43b75b-76c7-46ac-99b5-98988500e6fe tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1314 microversion: 2.1 time: 0.255450 Jul 14 12:19:50.625393 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 116/240] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:50 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:50.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8deb47c7-313d-46ab-8cdc-fe35f8f8eae3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:50.923632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8deb47c7-313d-46ab-8cdc-fe35f8f8eae3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.394617 Jul 14 12:19:50.924237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 125/241] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:50 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:51.639759 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-330161df-4549-47b2-9f3a-f669d8a29bd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:51.640498 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-330161df-4549-47b2-9f3a-f669d8a29bd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:51.648127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-330161df-4549-47b2-9f3a-f669d8a29bd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:51.648739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-330161df-4549-47b2-9f3a-f669d8a29bd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:51.649603 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-330161df-4549-47b2-9f3a-f669d8a29bd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:51.650154 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-330161df-4549-47b2-9f3a-f669d8a29bd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:51.830055 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-330161df-4549-47b2-9f3a-f669d8a29bd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:51.840331 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-330161df-4549-47b2-9f3a-f669d8a29bd3 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1314 microversion: 2.1 time: 0.204657 Jul 14 12:19:51.841233 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 117/242] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:51 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:51.942309 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ed20535e-d2f7-476a-9182-dfc9ed782822 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:51.944323 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ed20535e-d2f7-476a-9182-dfc9ed782822 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:51.955393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ed20535e-d2f7-476a-9182-dfc9ed782822 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:51.956253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ed20535e-d2f7-476a-9182-dfc9ed782822 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:51.957475 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ed20535e-d2f7-476a-9182-dfc9ed782822 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:51.958174 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ed20535e-d2f7-476a-9182-dfc9ed782822 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:52.217237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ed20535e-d2f7-476a-9182-dfc9ed782822 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:52.230328 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ed20535e-d2f7-476a-9182-dfc9ed782822 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.291827 Jul 14 12:19:52.237802 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 126/243] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:51 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:52.860275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a4e84fa1-e4a3-406b-910c-56f5d783d94b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:52.861626 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a4e84fa1-e4a3-406b-910c-56f5d783d94b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:52.884369 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4e84fa1-e4a3-406b-910c-56f5d783d94b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:52.885054 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4e84fa1-e4a3-406b-910c-56f5d783d94b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:52.886039 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4e84fa1-e4a3-406b-910c-56f5d783d94b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:52.886609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4e84fa1-e4a3-406b-910c-56f5d783d94b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:53.156477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a4e84fa1-e4a3-406b-910c-56f5d783d94b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:53.165724 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a4e84fa1-e4a3-406b-910c-56f5d783d94b tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1314 microversion: 2.1 time: 0.312033 Jul 14 12:19:53.166318 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 118/244] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:52 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:53.255400 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fd6fea8f-2be2-4030-a221-002c97be1b7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:53.256061 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fd6fea8f-2be2-4030-a221-002c97be1b7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:53.271116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fd6fea8f-2be2-4030-a221-002c97be1b7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:53.271592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fd6fea8f-2be2-4030-a221-002c97be1b7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:53.277235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fd6fea8f-2be2-4030-a221-002c97be1b7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:53.277690 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fd6fea8f-2be2-4030-a221-002c97be1b7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:53.805551 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-fd6fea8f-2be2-4030-a221-002c97be1b7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:53.819227 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fd6fea8f-2be2-4030-a221-002c97be1b7e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.568741 Jul 14 12:19:53.820499 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d70e532e-5ac2-457a-9eaf-a4733399a1c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Action: 'create', calling method: .version_select at 0x7f0e2674caf0>, body: {"keypair": {"name": "tempest-keypair-545319440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmKPe/tpezC6rdzpOYXyVWas8R5weQLziSN0MO60QunY0Qr0YhZYuvxMfq9iqDcqs3sgSd6ejgjiZM8EPenpgpXYOsv9UQ3JcH//D1KEvEV0mDirxzumx+q9Mzu5GkNWw=="}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:53.821908 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 127/245] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:53 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:53.846078 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-d70e532e-5ac2-457a-9eaf-a4733399a1c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Getting quotas for project 51617cc935204a6cba46c6d4d6a24cb3. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:19:53.855790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-d70e532e-5ac2-457a-9eaf-a4733399a1c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Getting quotas for user 15e708082e294dd9a0834ef21ea46fd9 and project 51617cc935204a6cba46c6d4d6a24cb3. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:19:53.933452 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d70e532e-5ac2-457a-9eaf-a4733399a1c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.590879 Jul 14 12:19:53.935184 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 119/246] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jul 14 12:19:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 593 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 12:19:54.184538 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b1cb12cc-1b6d-4fea-bcf3-cbe213814185 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:54.185295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b1cb12cc-1b6d-4fea-bcf3-cbe213814185 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:54.191810 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b1cb12cc-1b6d-4fea-bcf3-cbe213814185 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:54.192456 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b1cb12cc-1b6d-4fea-bcf3-cbe213814185 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:54.193381 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b1cb12cc-1b6d-4fea-bcf3-cbe213814185 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:54.193960 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b1cb12cc-1b6d-4fea-bcf3-cbe213814185 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:54.581940 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:54.607903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b1cb12cc-1b6d-4fea-bcf3-cbe213814185 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:54.619053 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b1cb12cc-1b6d-4fea-bcf3-cbe213814185 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1314 microversion: 2.1 time: 0.438393 Jul 14 12:19:54.623137 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 128/247] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:54 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:54.839995 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bc3dcdd9-e3bc-4ef4-8584-f2303246e6e2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:54.840941 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-bc3dcdd9-e3bc-4ef4-8584-f2303246e6e2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:54.842887 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:54.868229 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc3dcdd9-e3bc-4ef4-8584-f2303246e6e2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:54.873929 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc3dcdd9-e3bc-4ef4-8584-f2303246e6e2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:54.876490 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc3dcdd9-e3bc-4ef4-8584-f2303246e6e2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:54.877969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc3dcdd9-e3bc-4ef4-8584-f2303246e6e2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:55.087792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bc3dcdd9-e3bc-4ef4-8584-f2303246e6e2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:55.089916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bc3dcdd9-e3bc-4ef4-8584-f2303246e6e2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.254169 Jul 14 12:19:55.098994 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 120/248] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:54 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:55.638372 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-538f786d-4678-493f-b45b-8048b21921ca tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:55.639655 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-538f786d-4678-493f-b45b-8048b21921ca tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:55.648089 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-538f786d-4678-493f-b45b-8048b21921ca tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:55.649699 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-538f786d-4678-493f-b45b-8048b21921ca tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:55.649699 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-538f786d-4678-493f-b45b-8048b21921ca tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:55.651114 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-538f786d-4678-493f-b45b-8048b21921ca tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:55.904235 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-eaf81c2f-f06e-4224-8e92-9a800b1d69c9 req-85f6a46b-e86a-4644-90ae-99ebc2b3e5e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2d31b3-8a26-44d8-a55a-0435d3325df4", "name": "network-vif-plugged", "status": "completed", "tag": "e9341909-2ab9-4a65-9970-c79e8db5eafc"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:55.928152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-eaf81c2f-f06e-4224-8e92-9a800b1d69c9 req-85f6a46b-e86a-4644-90ae-99ebc2b3e5e4 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:55.930349 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-eaf81c2f-f06e-4224-8e92-9a800b1d69c9 req-85f6a46b-e86a-4644-90ae-99ebc2b3e5e4 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:55.949112 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-eaf81c2f-f06e-4224-8e92-9a800b1d69c9 req-85f6a46b-e86a-4644-90ae-99ebc2b3e5e4 service nova] Creating event network-vif-plugged:e9341909-2ab9-4a65-9970-c79e8db5eafc for instance dc2d31b3-8a26-44d8-a55a-0435d3325df4 on hv-cinder-84890 Jul 14 12:19:55.957484 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-eaf81c2f-f06e-4224-8e92-9a800b1d69c9 req-85f6a46b-e86a-4644-90ae-99ebc2b3e5e4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057675 Jul 14 12:19:55.958592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 121/249] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:19:56.013327 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-538f786d-4678-493f-b45b-8048b21921ca tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:56.034046 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-538f786d-4678-493f-b45b-8048b21921ca tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1314 microversion: 2.1 time: 0.400539 Jul 14 12:19:56.035651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 129/250] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:55 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:56.111113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b1b93da7-fe1f-42cf-ab0a-d3bb608cad53 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:56.112488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b1b93da7-fe1f-42cf-ab0a-d3bb608cad53 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:56.120645 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b1b93da7-fe1f-42cf-ab0a-d3bb608cad53 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:56.121573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b1b93da7-fe1f-42cf-ab0a-d3bb608cad53 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:56.122590 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b1b93da7-fe1f-42cf-ab0a-d3bb608cad53 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:56.125093 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b1b93da7-fe1f-42cf-ab0a-d3bb608cad53 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:56.790393 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b1b93da7-fe1f-42cf-ab0a-d3bb608cad53 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:56.800665 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b1b93da7-fe1f-42cf-ab0a-d3bb608cad53 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.693741 Jul 14 12:19:56.805935 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 122/251] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:56 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:57.054259 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c3288688-1778-4c76-9d00-c30b6c22c572 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:57.055869 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c3288688-1778-4c76-9d00-c30b6c22c572 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:57.068901 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3288688-1778-4c76-9d00-c30b6c22c572 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:57.069350 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3288688-1778-4c76-9d00-c30b6c22c572 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:57.075383 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3288688-1778-4c76-9d00-c30b6c22c572 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:57.076266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3288688-1778-4c76-9d00-c30b6c22c572 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:57.349863 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c3288688-1778-4c76-9d00-c30b6c22c572 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:57.385403 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c3288688-1778-4c76-9d00-c30b6c22c572 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1314 microversion: 2.1 time: 0.336327 Jul 14 12:19:57.387515 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 130/252] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:57 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:57.823852 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d5094e26-2fbc-4aa2-a4ac-a1296e0e2184 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:57.824530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d5094e26-2fbc-4aa2-a4ac-a1296e0e2184 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:57.850724 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d5094e26-2fbc-4aa2-a4ac-a1296e0e2184 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:57.851400 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d5094e26-2fbc-4aa2-a4ac-a1296e0e2184 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:57.852502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d5094e26-2fbc-4aa2-a4ac-a1296e0e2184 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:57.853103 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d5094e26-2fbc-4aa2-a4ac-a1296e0e2184 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:57.945128 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1193819211", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f1a9939-526e-4b6f-8865-71875a9e9ada"}], "security_groups": [{"name": "tempest-securitygroup--1841400974"}], "key_name": "tempest-keypair-545319440", "user_data": "}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:19:57.970705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:19:58.202412 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.network.neutron [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] validate_networks() for [('8f1a9939-526e-4b6f-8865-71875a9e9ada', None, None, None, None, None)] {{(pid=118262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:19:58.202976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d5094e26-2fbc-4aa2-a4ac-a1296e0e2184 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:58.212521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d5094e26-2fbc-4aa2-a4ac-a1296e0e2184 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.392819 Jul 14 12:19:58.216115 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 123/253] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:57 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:19:58.404916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4f807792-0e93-4328-a9c7-672ec5fc3b4c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:58.405985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4f807792-0e93-4328-a9c7-672ec5fc3b4c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:58.417658 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4f807792-0e93-4328-a9c7-672ec5fc3b4c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:58.419189 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4f807792-0e93-4328-a9c7-672ec5fc3b4c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:58.420498 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4f807792-0e93-4328-a9c7-672ec5fc3b4c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:58.421822 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4f807792-0e93-4328-a9c7-672ec5fc3b4c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:58.691275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4f807792-0e93-4328-a9c7-672ec5fc3b4c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:58.703797 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4f807792-0e93-4328-a9c7-672ec5fc3b4c tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1314 microversion: 2.1 time: 0.302073 Jul 14 12:19:58.705186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 124/254] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:58 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:59.112307 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Flavor limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:19:59.112668 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Image limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:19:59.113277 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Flavor pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:19:59.113685 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Image pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:19:59.114090 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:19:59.127392 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:59.129310 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:59.129310 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:59.129538 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:59.149841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Getting quotas for project 51617cc935204a6cba46c6d4d6a24cb3. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:19:59.154021 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Getting quotas for user 15e708082e294dd9a0834ef21ea46fd9 and project 51617cc935204a6cba46c6d4d6a24cb3. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:19:59.177961 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Going to run 1 instances... {{(pid=118262) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:19:59.180821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:19:59.233735 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-aeeac4c9-3dc7-421b-96c0-5580e3e03660 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:59.234806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-aeeac4c9-3dc7-421b-96c0-5580e3e03660 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:59.242940 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aeeac4c9-3dc7-421b-96c0-5580e3e03660 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:59.248801 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aeeac4c9-3dc7-421b-96c0-5580e3e03660 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:59.250059 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aeeac4c9-3dc7-421b-96c0-5580e3e03660 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:59.252159 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aeeac4c9-3dc7-421b-96c0-5580e3e03660 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:59.326412 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-65b262e9-416d-4dc4-a930-3d21e885f690 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.385082 Jul 14 12:19:59.327703 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 131/255] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jul 14 12:19:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1388 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 12:19:59.344141 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d49490d0-8c2e-4745-a1ad-0e944a5432e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:59.345047 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d49490d0-8c2e-4745-a1ad-0e944a5432e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:59.426661 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d49490d0-8c2e-4745-a1ad-0e944a5432e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:59.449377 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d49490d0-8c2e-4745-a1ad-0e944a5432e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:59.458554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d49490d0-8c2e-4745-a1ad-0e944a5432e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:59.461979 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d49490d0-8c2e-4745-a1ad-0e944a5432e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1281 microversion: 2.20 time: 0.124621 Jul 14 12:19:59.462558 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 132/256] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:19:59 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1281 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:19:59.720437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-efe971eb-ef9d-4398-95a5-27dfe96e458d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:19:59.721205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-efe971eb-ef9d-4398-95a5-27dfe96e458d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:19:59.733720 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-efe971eb-ef9d-4398-95a5-27dfe96e458d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:59.734555 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-efe971eb-ef9d-4398-95a5-27dfe96e458d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:59.736880 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-efe971eb-ef9d-4398-95a5-27dfe96e458d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:19:59.737540 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-efe971eb-ef9d-4398-95a5-27dfe96e458d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:19:59.749349 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-aeeac4c9-3dc7-421b-96c0-5580e3e03660 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:59.760392 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-aeeac4c9-3dc7-421b-96c0-5580e3e03660 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.531390 Jul 14 12:19:59.761802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 125/257] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:59 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:19:59.953395 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-efe971eb-ef9d-4398-95a5-27dfe96e458d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:19:59.965848 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-efe971eb-ef9d-4398-95a5-27dfe96e458d tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1314 microversion: 2.1 time: 0.249089 Jul 14 12:19:59.975563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 133/258] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:19:59 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:00.494252 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ea0a0221-d5ac-4afe-a6d3-ebdba4af4d29 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:00.495656 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ea0a0221-d5ac-4afe-a6d3-ebdba4af4d29 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:00.567937 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ea0a0221-d5ac-4afe-a6d3-ebdba4af4d29 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:00.577629 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ea0a0221-d5ac-4afe-a6d3-ebdba4af4d29 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:00.579304 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ea0a0221-d5ac-4afe-a6d3-ebdba4af4d29 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:00.580746 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ea0a0221-d5ac-4afe-a6d3-ebdba4af4d29 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1281 microversion: 2.20 time: 0.094486 Jul 14 12:20:00.582828 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 126/259] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:00 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:00.778511 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ac9615f6-d606-476b-931b-607f5581a1bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:00.779391 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ac9615f6-d606-476b-931b-607f5581a1bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:00.787241 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ac9615f6-d606-476b-931b-607f5581a1bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:00.787949 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ac9615f6-d606-476b-931b-607f5581a1bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:00.788853 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ac9615f6-d606-476b-931b-607f5581a1bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:00.789519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ac9615f6-d606-476b-931b-607f5581a1bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:00.927476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ac9615f6-d606-476b-931b-607f5581a1bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:00.935524 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ac9615f6-d606-476b-931b-607f5581a1bf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.161565 Jul 14 12:20:00.936098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 134/260] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:00 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:00.983722 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-39e1fdae-f334-46df-bffd-fb1237ad17e0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:00.984346 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-39e1fdae-f334-46df-bffd-fb1237ad17e0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:00.993544 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-39e1fdae-f334-46df-bffd-fb1237ad17e0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:00.993994 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-39e1fdae-f334-46df-bffd-fb1237ad17e0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:00.994791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-39e1fdae-f334-46df-bffd-fb1237ad17e0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:00.995262 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-39e1fdae-f334-46df-bffd-fb1237ad17e0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:01.412160 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-39e1fdae-f334-46df-bffd-fb1237ad17e0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:01.420657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-39e1fdae-f334-46df-bffd-fb1237ad17e0 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1314 microversion: 2.1 time: 0.441544 Jul 14 12:20:01.421229 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 127/261] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:00 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:01.599279 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-53db78c0-4627-476c-b2ea-f4aecb3ddee9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:01.599972 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-53db78c0-4627-476c-b2ea-f4aecb3ddee9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:01.607439 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53db78c0-4627-476c-b2ea-f4aecb3ddee9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:01.607892 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53db78c0-4627-476c-b2ea-f4aecb3ddee9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:01.608929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53db78c0-4627-476c-b2ea-f4aecb3ddee9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:01.609080 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53db78c0-4627-476c-b2ea-f4aecb3ddee9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:01.683805 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-53db78c0-4627-476c-b2ea-f4aecb3ddee9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:01.693491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-53db78c0-4627-476c-b2ea-f4aecb3ddee9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:01.696319 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-53db78c0-4627-476c-b2ea-f4aecb3ddee9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:01.697586 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-53db78c0-4627-476c-b2ea-f4aecb3ddee9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1285 microversion: 2.20 time: 0.102788 Jul 14 12:20:01.699184 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 135/262] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:01 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:01.953367 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-baa3b765-b75f-435c-8cd9-95878603a99a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:01.953992 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-baa3b765-b75f-435c-8cd9-95878603a99a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:01.964113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-baa3b765-b75f-435c-8cd9-95878603a99a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:01.965135 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-baa3b765-b75f-435c-8cd9-95878603a99a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:01.967753 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-baa3b765-b75f-435c-8cd9-95878603a99a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:01.969360 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-baa3b765-b75f-435c-8cd9-95878603a99a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:02.250384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-baa3b765-b75f-435c-8cd9-95878603a99a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:02.259178 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-baa3b765-b75f-435c-8cd9-95878603a99a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.310392 Jul 14 12:20:02.265155 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 128/263] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:01 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:02.438602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9b1cc8fc-fb18-4c5e-8c6c-9ad467f829c7 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:02.439221 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-9b1cc8fc-fb18-4c5e-8c6c-9ad467f829c7 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:02.445565 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9b1cc8fc-fb18-4c5e-8c6c-9ad467f829c7 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:02.446015 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9b1cc8fc-fb18-4c5e-8c6c-9ad467f829c7 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:02.446803 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9b1cc8fc-fb18-4c5e-8c6c-9ad467f829c7 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:02.447242 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9b1cc8fc-fb18-4c5e-8c6c-9ad467f829c7 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:02.676990 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9b1cc8fc-fb18-4c5e-8c6c-9ad467f829c7 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:02.687593 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9b1cc8fc-fb18-4c5e-8c6c-9ad467f829c7 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1497 microversion: 2.1 time: 0.253212 Jul 14 12:20:02.688502 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 136/264] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:02 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1497 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:20:02.722012 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0be3f2f5-a744-4f1b-8db6-d4327116ff18 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:02.728464 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0be3f2f5-a744-4f1b-8db6-d4327116ff18 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:02.736588 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0be3f2f5-a744-4f1b-8db6-d4327116ff18 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:02.737285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0be3f2f5-a744-4f1b-8db6-d4327116ff18 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:02.738215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0be3f2f5-a744-4f1b-8db6-d4327116ff18 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:02.738872 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0be3f2f5-a744-4f1b-8db6-d4327116ff18 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:02.864889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0be3f2f5-a744-4f1b-8db6-d4327116ff18 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:02.876004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0be3f2f5-a744-4f1b-8db6-d4327116ff18 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:02.877969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0be3f2f5-a744-4f1b-8db6-d4327116ff18 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:02.879146 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0be3f2f5-a744-4f1b-8db6-d4327116ff18 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1277 microversion: 2.20 time: 0.161451 Jul 14 12:20:02.880106 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 129/265] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:02 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:03.277772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-de0370a3-fdd0-45be-a708-c5f46bb08702 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:03.279248 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-de0370a3-fdd0-45be-a708-c5f46bb08702 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:03.296440 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-de0370a3-fdd0-45be-a708-c5f46bb08702 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:03.296440 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-de0370a3-fdd0-45be-a708-c5f46bb08702 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:03.296440 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-de0370a3-fdd0-45be-a708-c5f46bb08702 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:03.296440 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-de0370a3-fdd0-45be-a708-c5f46bb08702 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:03.518807 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-de0370a3-fdd0-45be-a708-c5f46bb08702 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:03.534135 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-de0370a3-fdd0-45be-a708-c5f46bb08702 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.260171 Jul 14 12:20:03.535481 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 137/266] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:03 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:03.901685 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b5ba0900-48c3-487f-85bd-26761b119017 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:03.903018 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b5ba0900-48c3-487f-85bd-26761b119017 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:03.910527 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b5ba0900-48c3-487f-85bd-26761b119017 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:03.911516 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b5ba0900-48c3-487f-85bd-26761b119017 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:03.913147 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b5ba0900-48c3-487f-85bd-26761b119017 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:03.914583 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b5ba0900-48c3-487f-85bd-26761b119017 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:04.142599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b5ba0900-48c3-487f-85bd-26761b119017 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:04.154368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b5ba0900-48c3-487f-85bd-26761b119017 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:04.158030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b5ba0900-48c3-487f-85bd-26761b119017 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:04.164641 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b5ba0900-48c3-487f-85bd-26761b119017 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1333 microversion: 2.20 time: 0.264575 Jul 14 12:20:04.166133 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 130/267] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:03 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1333 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:04.553807 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fca38211-7071-40c0-ba78-6f6ee792e4af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:04.554584 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fca38211-7071-40c0-ba78-6f6ee792e4af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:04.566200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fca38211-7071-40c0-ba78-6f6ee792e4af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:04.566651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fca38211-7071-40c0-ba78-6f6ee792e4af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:04.567447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fca38211-7071-40c0-ba78-6f6ee792e4af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:04.567876 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fca38211-7071-40c0-ba78-6f6ee792e4af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:04.592068 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=100 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:04.732048 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-fca38211-7071-40c0-ba78-6f6ee792e4af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:04.741609 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fca38211-7071-40c0-ba78-6f6ee792e4af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.193722 Jul 14 12:20:04.742184 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 138/268] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:04 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:05.186352 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-93c69815-7da6-4614-936f-e87b76e11e48 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:05.188054 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-93c69815-7da6-4614-936f-e87b76e11e48 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:05.197825 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-93c69815-7da6-4614-936f-e87b76e11e48 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:05.198811 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-93c69815-7da6-4614-936f-e87b76e11e48 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:05.205304 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-93c69815-7da6-4614-936f-e87b76e11e48 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:05.205304 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-93c69815-7da6-4614-936f-e87b76e11e48 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:05.335450 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-93c69815-7da6-4614-936f-e87b76e11e48 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:05.347792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-93c69815-7da6-4614-936f-e87b76e11e48 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:05.350036 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-93c69815-7da6-4614-936f-e87b76e11e48 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:05.351687 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-93c69815-7da6-4614-936f-e87b76e11e48 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1333 microversion: 2.20 time: 0.171620 Jul 14 12:20:05.352920 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 131/269] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:05 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1333 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:05.762407 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-20f34b35-6f94-45b1-b5f3-16754c0ec1bd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:05.763647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-20f34b35-6f94-45b1-b5f3-16754c0ec1bd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:05.785255 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-20f34b35-6f94-45b1-b5f3-16754c0ec1bd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:05.789238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-20f34b35-6f94-45b1-b5f3-16754c0ec1bd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:05.789238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-20f34b35-6f94-45b1-b5f3-16754c0ec1bd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:05.789238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-20f34b35-6f94-45b1-b5f3-16754c0ec1bd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:05.969612 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-20f34b35-6f94-45b1-b5f3-16754c0ec1bd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:05.992913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-20f34b35-6f94-45b1-b5f3-16754c0ec1bd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.237540 Jul 14 12:20:05.994197 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 139/270] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:05 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:06.242043 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-47a9771e-757f-41cf-bd55-be7736ab05ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:06.243158 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-47a9771e-757f-41cf-bd55-be7736ab05ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:06.252564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47a9771e-757f-41cf-bd55-be7736ab05ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:06.256305 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47a9771e-757f-41cf-bd55-be7736ab05ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:06.259297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47a9771e-757f-41cf-bd55-be7736ab05ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:06.259911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47a9771e-757f-41cf-bd55-be7736ab05ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:06.307197 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-47a9771e-757f-41cf-bd55-be7736ab05ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Going to try to terminate instance {{(pid=118263) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:20:06.353951 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:06.384143 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e7a2b5ca-b6e3-48e6-b4c5-f2aed5ea6413 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:06.385234 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e7a2b5ca-b6e3-48e6-b4c5-f2aed5ea6413 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:06.395076 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e7a2b5ca-b6e3-48e6-b4c5-f2aed5ea6413 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:06.395807 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e7a2b5ca-b6e3-48e6-b4c5-f2aed5ea6413 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:06.396950 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e7a2b5ca-b6e3-48e6-b4c5-f2aed5ea6413 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:06.397898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e7a2b5ca-b6e3-48e6-b4c5-f2aed5ea6413 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:06.504394 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e7a2b5ca-b6e3-48e6-b4c5-f2aed5ea6413 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:06.518455 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e7a2b5ca-b6e3-48e6-b4c5-f2aed5ea6413 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:06.520267 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e7a2b5ca-b6e3-48e6-b4c5-f2aed5ea6413 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:06.521895 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e7a2b5ca-b6e3-48e6-b4c5-f2aed5ea6413 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1351 microversion: 2.20 time: 0.142916 Jul 14 12:20:06.533881 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 140/271] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:06 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1351 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:06.648400 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-47a9771e-757f-41cf-bd55-be7736ab05ad tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 204 len: 0 microversion: 2.1 time: 0.410526 Jul 14 12:20:06.649338 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 132/272] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:20:06 2022] DELETE /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:20:06.659417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c6883529-50a5-4834-9178-49fac78a9b91 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:06.660027 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c6883529-50a5-4834-9178-49fac78a9b91 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:06.667707 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6883529-50a5-4834-9178-49fac78a9b91 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:06.668167 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6883529-50a5-4834-9178-49fac78a9b91 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:06.669125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6883529-50a5-4834-9178-49fac78a9b91 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:06.669566 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6883529-50a5-4834-9178-49fac78a9b91 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:06.961438 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c6883529-50a5-4834-9178-49fac78a9b91 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:06.975439 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c6883529-50a5-4834-9178-49fac78a9b91 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1503 microversion: 2.1 time: 0.318919 Jul 14 12:20:06.976491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 141/273] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:06 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1503 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:07.015189 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0c7cfe85-ba6e-4c1d-b37d-1e618b331895 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:07.016047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0c7cfe85-ba6e-4c1d-b37d-1e618b331895 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:07.032997 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0c7cfe85-ba6e-4c1d-b37d-1e618b331895 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:07.034271 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0c7cfe85-ba6e-4c1d-b37d-1e618b331895 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:07.035579 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0c7cfe85-ba6e-4c1d-b37d-1e618b331895 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:07.036765 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0c7cfe85-ba6e-4c1d-b37d-1e618b331895 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:07.403705 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0c7cfe85-ba6e-4c1d-b37d-1e618b331895 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:07.416440 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0c7cfe85-ba6e-4c1d-b37d-1e618b331895 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.406532 Jul 14 12:20:07.417896 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 133/274] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:07 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:07.543798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f779f544-3389-4c85-8e67-d6ff8f922d42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:07.544295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f779f544-3389-4c85-8e67-d6ff8f922d42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:07.550876 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f779f544-3389-4c85-8e67-d6ff8f922d42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:07.551516 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f779f544-3389-4c85-8e67-d6ff8f922d42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:07.552815 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f779f544-3389-4c85-8e67-d6ff8f922d42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:07.553504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f779f544-3389-4c85-8e67-d6ff8f922d42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:07.628617 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f779f544-3389-4c85-8e67-d6ff8f922d42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:07.638710 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f779f544-3389-4c85-8e67-d6ff8f922d42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:07.640529 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f779f544-3389-4c85-8e67-d6ff8f922d42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:07.641853 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f779f544-3389-4c85-8e67-d6ff8f922d42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1339 microversion: 2.20 time: 0.102997 Jul 14 12:20:07.653533 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 142/275] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:07 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:07.993767 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c5b47abf-f009-4223-a360-6a760fcbe2a1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:07.994697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c5b47abf-f009-4223-a360-6a760fcbe2a1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:08.018181 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c5b47abf-f009-4223-a360-6a760fcbe2a1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:08.018696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c5b47abf-f009-4223-a360-6a760fcbe2a1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:08.020531 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c5b47abf-f009-4223-a360-6a760fcbe2a1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:08.021256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c5b47abf-f009-4223-a360-6a760fcbe2a1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:08.339147 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c5b47abf-f009-4223-a360-6a760fcbe2a1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:08.352668 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c5b47abf-f009-4223-a360-6a760fcbe2a1 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1503 microversion: 2.1 time: 0.362868 Jul 14 12:20:08.363850 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 134/276] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:07 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1503 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:08.435068 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c49e9db0-8a39-4617-b444-ac3acd4dd153 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:08.435688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c49e9db0-8a39-4617-b444-ac3acd4dd153 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:08.446721 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c49e9db0-8a39-4617-b444-ac3acd4dd153 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:08.453101 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c49e9db0-8a39-4617-b444-ac3acd4dd153 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:08.454165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c49e9db0-8a39-4617-b444-ac3acd4dd153 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:08.454718 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c49e9db0-8a39-4617-b444-ac3acd4dd153 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:08.645504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c49e9db0-8a39-4617-b444-ac3acd4dd153 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:08.656192 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c49e9db0-8a39-4617-b444-ac3acd4dd153 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1522 microversion: 2.1 time: 0.225540 Jul 14 12:20:08.662965 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-73cc8719-743f-4579-a014-50699e924463 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:08.664368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-73cc8719-743f-4579-a014-50699e924463 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:08.668029 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 143/277] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:08 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:08.678721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-73cc8719-743f-4579-a014-50699e924463 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:08.680516 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-73cc8719-743f-4579-a014-50699e924463 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:08.681634 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-73cc8719-743f-4579-a014-50699e924463 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:08.682093 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-73cc8719-743f-4579-a014-50699e924463 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:09.164546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-73cc8719-743f-4579-a014-50699e924463 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:09.177683 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-73cc8719-743f-4579-a014-50699e924463 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:09.186472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-73cc8719-743f-4579-a014-50699e924463 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:09.192963 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-73cc8719-743f-4579-a014-50699e924463 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.535196 Jul 14 12:20:09.192963 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 135/278] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:08 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:20:09.217763 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:09.371396 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ac652fc6-7508-44fc-ba2a-3bb61ad6fd51 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:09.372026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ac652fc6-7508-44fc-ba2a-3bb61ad6fd51 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:09.380575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ac652fc6-7508-44fc-ba2a-3bb61ad6fd51 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:09.381266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ac652fc6-7508-44fc-ba2a-3bb61ad6fd51 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:09.382315 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ac652fc6-7508-44fc-ba2a-3bb61ad6fd51 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:09.383277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ac652fc6-7508-44fc-ba2a-3bb61ad6fd51 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:09.446109 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=8 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:09.555391 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e490d11d-0ac0-40cc-a9fd-1a27de718961 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Action: 'create', calling method: .version_select at 0x7f0e2711a040>, body: {"keypair": {"name": "tempest-TestShelveInstance-70849047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDZk+qQh3QAg0iJxb6XfF688bbfDbQmNmgo8isTDS3kHFsYAo0o+D81t4k0uNKWHYtJv9hQ9uoLnNfow1NO2O/l6nfeTMIQoPiiqvPQU8CYwjqwVluL12BbjYZ7woVuu8w=="}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:09.573998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-e490d11d-0ac0-40cc-a9fd-1a27de718961 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Getting quotas for project dfa18dfa445442d4be02d187ed24325f. Resources: {'key_pairs'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:20:09.579079 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-e490d11d-0ac0-40cc-a9fd-1a27de718961 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Getting quotas for user 7489ed79115044388225314714876f24 and project dfa18dfa445442d4be02d187ed24325f. Resources: {'key_pairs'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:20:09.666548 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ac652fc6-7508-44fc-ba2a-3bb61ad6fd51 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:09.677965 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ac652fc6-7508-44fc-ba2a-3bb61ad6fd51 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1503 microversion: 2.1 time: 0.311799 Jul 14 12:20:09.678577 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 136/279] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:09 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1503 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:09.685615 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a0dfdcf4-c2ff-4937-a881-cc644bb296e0 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:09.686383 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a0dfdcf4-c2ff-4937-a881-cc644bb296e0 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:09.694428 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a0dfdcf4-c2ff-4937-a881-cc644bb296e0 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:09.695096 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a0dfdcf4-c2ff-4937-a881-cc644bb296e0 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:09.695864 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a0dfdcf4-c2ff-4937-a881-cc644bb296e0 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:09.696470 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a0dfdcf4-c2ff-4937-a881-cc644bb296e0 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:09.724178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e490d11d-0ac0-40cc-a9fd-1a27de718961 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.512648 Jul 14 12:20:09.724987 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 144/280] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 12:20:09 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:20:10.083837 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a0dfdcf4-c2ff-4937-a881-cc644bb296e0 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:10.117392 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a0dfdcf4-c2ff-4937-a881-cc644bb296e0 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1502 microversion: 2.1 time: 0.431478 Jul 14 12:20:10.121298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 137/281] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:09 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1502 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:10.137616 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4a3117fd-10cc-4227-87b9-14ccd315644a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:10.138657 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4a3117fd-10cc-4227-87b9-14ccd315644a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:10.146124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a3117fd-10cc-4227-87b9-14ccd315644a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:10.147998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a3117fd-10cc-4227-87b9-14ccd315644a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:10.149457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a3117fd-10cc-4227-87b9-14ccd315644a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:10.150051 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a3117fd-10cc-4227-87b9-14ccd315644a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:10.217928 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0aa8894d-7566-4be2-8d1a-3d561f93dc14 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:10.218689 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0aa8894d-7566-4be2-8d1a-3d561f93dc14 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:10.226739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0aa8894d-7566-4be2-8d1a-3d561f93dc14 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:10.228737 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0aa8894d-7566-4be2-8d1a-3d561f93dc14 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:10.230363 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0aa8894d-7566-4be2-8d1a-3d561f93dc14 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:10.231832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0aa8894d-7566-4be2-8d1a-3d561f93dc14 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:10.340685 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4a3117fd-10cc-4227-87b9-14ccd315644a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:10.362622 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4a3117fd-10cc-4227-87b9-14ccd315644a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1516 microversion: 2.1 time: 0.214825 Jul 14 12:20:10.362622 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 145/282] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:10 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1516 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:10.362622 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-da8fcace-302d-4b5d-9f4a-ebd5740f1ec9 req-a6f488ba-35cf-4afd-8cf0-a4905f4f6e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc2d31b3-8a26-44d8-a55a-0435d3325df4", "name": "network-vif-deleted", "tag": "e9341909-2ab9-4a65-9970-c79e8db5eafc"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:10.364765 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-da8fcace-302d-4b5d-9f4a-ebd5740f1ec9 req-a6f488ba-35cf-4afd-8cf0-a4905f4f6e53 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:10.365113 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-da8fcace-302d-4b5d-9f4a-ebd5740f1ec9 req-a6f488ba-35cf-4afd-8cf0-a4905f4f6e53 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:10.516559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0aa8894d-7566-4be2-8d1a-3d561f93dc14 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:10.534451 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0aa8894d-7566-4be2-8d1a-3d561f93dc14 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:10.541343 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0aa8894d-7566-4be2-8d1a-3d561f93dc14 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:10.544346 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0aa8894d-7566-4be2-8d1a-3d561f93dc14 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.330611 Jul 14 12:20:10.562726 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 138/283] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:10 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:20:10.581236 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-da8fcace-302d-4b5d-9f4a-ebd5740f1ec9 req-a6f488ba-35cf-4afd-8cf0-a4905f4f6e53 service nova] Creating event network-vif-deleted:e9341909-2ab9-4a65-9970-c79e8db5eafc for instance dc2d31b3-8a26-44d8-a55a-0435d3325df4 on hv-cinder-84890 Jul 14 12:20:10.594225 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-da8fcace-302d-4b5d-9f4a-ebd5740f1ec9 req-a6f488ba-35cf-4afd-8cf0-a4905f4f6e53 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239472 Jul 14 12:20:10.598297 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 146/284] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:20:10.708619 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:10.709441 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:10.721623 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=12 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:10.729731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:10.730215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:10.731495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:10.731495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:10.768166 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:10.768617 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:10.769093 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lazy-loading 'fault' on Instance uuid dc2d31b3-8a26-44d8-a55a-0435d3325df4 {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:20:10.842362 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ccee18a56e44ccebfa14d264deb219b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bf2b73c991f489d915d7124b5d24564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:10.850923 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-94480003-88f9-43f3-a31c-516280baa824 tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 200 len: 1304 microversion: 2.1 time: 0.157612 Jul 14 12:20:10.851434 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 139/285] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:10 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 1304 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:11.565480 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-edc73b37-3ef4-43c7-93bc-5a0bd2930f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:11.566400 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-edc73b37-3ef4-43c7-93bc-5a0bd2930f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:11.577229 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-edc73b37-3ef4-43c7-93bc-5a0bd2930f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:11.578087 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-edc73b37-3ef4-43c7-93bc-5a0bd2930f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:11.579219 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-edc73b37-3ef4-43c7-93bc-5a0bd2930f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:11.579901 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-edc73b37-3ef4-43c7-93bc-5a0bd2930f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:11.724409 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-edc73b37-3ef4-43c7-93bc-5a0bd2930f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:11.734919 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-edc73b37-3ef4-43c7-93bc-5a0bd2930f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:11.736445 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-edc73b37-3ef4-43c7-93bc-5a0bd2930f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:11.737599 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-edc73b37-3ef4-43c7-93bc-5a0bd2930f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.178427 Jul 14 12:20:11.738337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 147/286] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:11 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:11.872166 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a437e9ff-e004-4f52-8134-e7561f55c7ec tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:11.873384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a437e9ff-e004-4f52-8134-e7561f55c7ec tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] [instance: dc2d31b3-8a26-44d8-a55a-0435d3325df4] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:11.879789 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a437e9ff-e004-4f52-8134-e7561f55c7ec tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:11.880507 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a437e9ff-e004-4f52-8134-e7561f55c7ec tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:11.881495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a437e9ff-e004-4f52-8134-e7561f55c7ec tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:11.882060 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a437e9ff-e004-4f52-8134-e7561f55c7ec tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:11.912183 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-a437e9ff-e004-4f52-8134-e7561f55c7ec tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] HTTP exception thrown: Instance dc2d31b3-8a26-44d8-a55a-0435d3325df4 could not be found. Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a437e9ff-e004-4f52-8134-e7561f55c7ec tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Request method failure captured: Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 HTTP/1.1 Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Am4gqz6xbbMzca82VQ1kPbdsI4yrS_05HHmfinRyNhNNKkyv2KR-0Cu83fVY17ERTdjo2WNx13L-UFzp1vZkrO3ueVPEwVcrYdQVAg_z2MT0UATeYK84mpUsfU1Y5LtqCOSE6JZ2XFVrcBd8PtH_kpmmzBhaVy1UaCSNMftpTd3nYo Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 8bf2b73c991f489d915d7124b5d24564 Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-VolumesActionsTest-1321194053 Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:20:11.914286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_8bf2b73c991f489d915d7124b5d24564", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/8bf2b73c991f489d915d7124b5d24564"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bf2b73c991f489d915d7124b5d24564"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/8bf2b73c991f489d915d7124b5d24564"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-VolumesActionsTest-1321194053 Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 8bf2b73c991f489d915d7124b5d24564 Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-VolumesActionsTest-1321194053 Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-VolumesActionsTest-1321194053-project Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 3ccee18a56e44ccebfa14d264deb219b Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-VolumesActionsTest-1321194053-project Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance dc2d31b3-8a26-44d8-a55a-0435d3325df4 could not be found. Jul 14 12:20:11.917739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'dc2d31b3-8a26-44d8-a55a-0435d3325df4'} Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc2d31b3-8a26-44d8-a55a-0435d3325df4 could not be found. Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:20:11.918744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc2d31b3-8a26-44d8-a55a-0435d3325df4 could not be found. Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc2d31b3-8a26-44d8-a55a-0435d3325df4 could not be found. Jul 14 12:20:11.920575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:20:11.925364 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a437e9ff-e004-4f52-8134-e7561f55c7ec tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] Returning 404 to user: Instance dc2d31b3-8a26-44d8-a55a-0435d3325df4 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:20:11.925364 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a437e9ff-e004-4f52-8134-e7561f55c7ec tempest-VolumesActionsTest-1321194053 tempest-VolumesActionsTest-1321194053-project] 10.222.0.27 "GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4" status: 404 len: 111 microversion: 2.1 time: 0.050404 Jul 14 12:20:11.925364 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 140/287] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:11 2022] GET /compute/v2.1/servers/dc2d31b3-8a26-44d8-a55a-0435d3325df4 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:20:12.628124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-33f2b7de-cd12-4c0e-a52b-f21b7bfad142 req-9886d38e-7f7a-49a4-a4cf-db4323793bd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d88a179-83e5-4361-8948-8a2632512eaf", "tag": "0091e22f-2f09-4a5d-9bd6-143e3f69992b"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:12.639061 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-33f2b7de-cd12-4c0e-a52b-f21b7bfad142 req-9886d38e-7f7a-49a4-a4cf-db4323793bd4 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:12.639926 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-33f2b7de-cd12-4c0e-a52b-f21b7bfad142 req-9886d38e-7f7a-49a4-a4cf-db4323793bd4 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:12.657501 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-33f2b7de-cd12-4c0e-a52b-f21b7bfad142 req-9886d38e-7f7a-49a4-a4cf-db4323793bd4 service nova] Creating event network-changed:0091e22f-2f09-4a5d-9bd6-143e3f69992b for instance 4d88a179-83e5-4361-8948-8a2632512eaf on hv-cinder-84890 Jul 14 12:20:12.664516 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-33f2b7de-cd12-4c0e-a52b-f21b7bfad142 req-9886d38e-7f7a-49a4-a4cf-db4323793bd4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049989 Jul 14 12:20:12.669011 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 148/288] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:20:12.691632 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b83d7f3a-c13b-4266-a8b4-9d026e1e8de9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:12.692422 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b83d7f3a-c13b-4266-a8b4-9d026e1e8de9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:12.705599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83d7f3a-c13b-4266-a8b4-9d026e1e8de9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:12.706058 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83d7f3a-c13b-4266-a8b4-9d026e1e8de9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:12.706961 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83d7f3a-c13b-4266-a8b4-9d026e1e8de9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:12.707410 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83d7f3a-c13b-4266-a8b4-9d026e1e8de9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:12.756965 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e2b9841b-36bd-4d4f-9e29-381d11488117 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:12.761244 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e2b9841b-36bd-4d4f-9e29-381d11488117 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:12.770217 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e2b9841b-36bd-4d4f-9e29-381d11488117 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:12.771280 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e2b9841b-36bd-4d4f-9e29-381d11488117 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:12.772341 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e2b9841b-36bd-4d4f-9e29-381d11488117 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:12.772925 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e2b9841b-36bd-4d4f-9e29-381d11488117 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:12.806263 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b83d7f3a-c13b-4266-a8b4-9d026e1e8de9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/ips" status: 200 len: 144 microversion: 2.1 time: 0.119471 Jul 14 12:20:12.811049 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 141/289] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:20:12 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/ips => generated 144 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:20:12.819698 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5685f8ce-1052-4009-940d-a560fe24cbb5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:12.825375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5685f8ce-1052-4009-940d-a560fe24cbb5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:12.857177 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5685f8ce-1052-4009-940d-a560fe24cbb5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:12.857177 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5685f8ce-1052-4009-940d-a560fe24cbb5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:12.857177 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5685f8ce-1052-4009-940d-a560fe24cbb5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:12.857177 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5685f8ce-1052-4009-940d-a560fe24cbb5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:12.890406 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-5685f8ce-1052-4009-940d-a560fe24cbb5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lazy-loading 'flavor' on Instance uuid bc2b616c-dc02-4d81-9eb1-028c8077a4fe {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:20:13.016032 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e2b9841b-36bd-4d4f-9e29-381d11488117 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:13.024331 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e2b9841b-36bd-4d4f-9e29-381d11488117 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:13.026360 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e2b9841b-36bd-4d4f-9e29-381d11488117 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:13.028099 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e2b9841b-36bd-4d4f-9e29-381d11488117 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.275835 Jul 14 12:20:13.028822 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 149/290] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:12 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:13.301643 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5685f8ce-1052-4009-940d-a560fe24cbb5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe/action" status: 200 len: 32 microversion: 2.1 time: 0.489026 Jul 14 12:20:13.302415 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 142/291] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:20:12 2022] POST /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe/action => generated 32 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 12:20:13.312925 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cfe0159b-3cb8-42f1-8d58-fc42da8f46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:13.313626 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-cfe0159b-3cb8-42f1-8d58-fc42da8f46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:13.319839 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfe0159b-3cb8-42f1-8d58-fc42da8f46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:13.321714 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfe0159b-3cb8-42f1-8d58-fc42da8f46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:13.322760 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfe0159b-3cb8-42f1-8d58-fc42da8f46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:13.323487 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfe0159b-3cb8-42f1-8d58-fc42da8f46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:13.494498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-cfe0159b-3cb8-42f1-8d58-fc42da8f46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:13.502527 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cfe0159b-3cb8-42f1-8d58-fc42da8f46d7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.193881 Jul 14 12:20:13.503268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 150/292] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:13 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:14.050022 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cab9a0d8-f33e-4e98-8601-63c5483e57f9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:14.051311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-cab9a0d8-f33e-4e98-8601-63c5483e57f9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:14.058735 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cab9a0d8-f33e-4e98-8601-63c5483e57f9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:14.059291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cab9a0d8-f33e-4e98-8601-63c5483e57f9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:14.060164 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cab9a0d8-f33e-4e98-8601-63c5483e57f9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:14.060705 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cab9a0d8-f33e-4e98-8601-63c5483e57f9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:14.195260 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-cab9a0d8-f33e-4e98-8601-63c5483e57f9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:14.204396 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-cab9a0d8-f33e-4e98-8601-63c5483e57f9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:14.206014 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-cab9a0d8-f33e-4e98-8601-63c5483e57f9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:14.207140 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-cab9a0d8-f33e-4e98-8601-63c5483e57f9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.162270 Jul 14 12:20:14.207766 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 143/293] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:14 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:14.519254 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5f62b9b7-becf-49f8-9783-422cd8b2b837 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:14.519872 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5f62b9b7-becf-49f8-9783-422cd8b2b837 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:14.526471 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5f62b9b7-becf-49f8-9783-422cd8b2b837 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:14.528259 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5f62b9b7-becf-49f8-9783-422cd8b2b837 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:14.528259 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5f62b9b7-becf-49f8-9783-422cd8b2b837 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:14.528259 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5f62b9b7-becf-49f8-9783-422cd8b2b837 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:14.660994 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5f62b9b7-becf-49f8-9783-422cd8b2b837 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:14.668826 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5f62b9b7-becf-49f8-9783-422cd8b2b837 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.153400 Jul 14 12:20:14.669417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 151/294] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:14 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:15.224704 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bfb10abe-3604-444a-b1df-d5da4e2b3f3c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:15.225314 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-bfb10abe-3604-444a-b1df-d5da4e2b3f3c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:15.231913 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bfb10abe-3604-444a-b1df-d5da4e2b3f3c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:15.232364 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bfb10abe-3604-444a-b1df-d5da4e2b3f3c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:15.233125 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bfb10abe-3604-444a-b1df-d5da4e2b3f3c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:15.233558 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bfb10abe-3604-444a-b1df-d5da4e2b3f3c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:15.385981 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bfb10abe-3604-444a-b1df-d5da4e2b3f3c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:15.398620 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bfb10abe-3604-444a-b1df-d5da4e2b3f3c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:15.403083 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bfb10abe-3604-444a-b1df-d5da4e2b3f3c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:15.403910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bfb10abe-3604-444a-b1df-d5da4e2b3f3c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.182494 Jul 14 12:20:15.417455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 144/295] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:15 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:15.687001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e4e88505-8068-4415-8208-99222e7efec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:15.689970 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e4e88505-8068-4415-8208-99222e7efec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:15.697141 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e4e88505-8068-4415-8208-99222e7efec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:15.697726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e4e88505-8068-4415-8208-99222e7efec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:15.698738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e4e88505-8068-4415-8208-99222e7efec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:15.699318 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e4e88505-8068-4415-8208-99222e7efec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:15.875119 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e4e88505-8068-4415-8208-99222e7efec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:15.883526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e4e88505-8068-4415-8208-99222e7efec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.201761 Jul 14 12:20:15.884088 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 152/296] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:15 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:16.425520 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d667cafa-c9a3-4834-b6a1-85e5ff1104cd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:16.426481 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d667cafa-c9a3-4834-b6a1-85e5ff1104cd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:16.437473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d667cafa-c9a3-4834-b6a1-85e5ff1104cd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:16.438060 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d667cafa-c9a3-4834-b6a1-85e5ff1104cd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:16.438967 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d667cafa-c9a3-4834-b6a1-85e5ff1104cd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:16.439425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d667cafa-c9a3-4834-b6a1-85e5ff1104cd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:16.578086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d667cafa-c9a3-4834-b6a1-85e5ff1104cd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:16.586264 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d667cafa-c9a3-4834-b6a1-85e5ff1104cd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:16.587839 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d667cafa-c9a3-4834-b6a1-85e5ff1104cd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:16.589632 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d667cafa-c9a3-4834-b6a1-85e5ff1104cd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.170376 Jul 14 12:20:16.590195 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 145/297] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:16 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:16.904915 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3d86f3e4-85c7-4874-9dfe-f312c790d979 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:16.905492 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3d86f3e4-85c7-4874-9dfe-f312c790d979 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:16.911536 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3d86f3e4-85c7-4874-9dfe-f312c790d979 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:16.911983 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3d86f3e4-85c7-4874-9dfe-f312c790d979 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:16.912744 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3d86f3e4-85c7-4874-9dfe-f312c790d979 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:16.913178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3d86f3e4-85c7-4874-9dfe-f312c790d979 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:17.061656 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3d86f3e4-85c7-4874-9dfe-f312c790d979 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:17.076431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3d86f3e4-85c7-4874-9dfe-f312c790d979 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.175572 Jul 14 12:20:17.077004 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 153/298] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:16 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:17.608458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-59b74c61-ae55-4f58-b295-7ca4a22b485b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:17.609054 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-59b74c61-ae55-4f58-b295-7ca4a22b485b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:17.615587 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-59b74c61-ae55-4f58-b295-7ca4a22b485b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:17.616030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-59b74c61-ae55-4f58-b295-7ca4a22b485b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:17.616797 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-59b74c61-ae55-4f58-b295-7ca4a22b485b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:17.617229 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-59b74c61-ae55-4f58-b295-7ca4a22b485b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:17.819882 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-59b74c61-ae55-4f58-b295-7ca4a22b485b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:17.828651 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-59b74c61-ae55-4f58-b295-7ca4a22b485b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:17.830350 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-59b74c61-ae55-4f58-b295-7ca4a22b485b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:17.831516 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-59b74c61-ae55-4f58-b295-7ca4a22b485b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.226966 Jul 14 12:20:17.832241 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 146/299] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:17 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:18.092721 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6be574e2-63e8-445a-9a55-7eaa1205287e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:18.093326 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6be574e2-63e8-445a-9a55-7eaa1205287e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:18.099339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6be574e2-63e8-445a-9a55-7eaa1205287e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:18.099779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6be574e2-63e8-445a-9a55-7eaa1205287e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:18.100533 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6be574e2-63e8-445a-9a55-7eaa1205287e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:18.100959 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6be574e2-63e8-445a-9a55-7eaa1205287e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:18.239295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6be574e2-63e8-445a-9a55-7eaa1205287e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:18.246949 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6be574e2-63e8-445a-9a55-7eaa1205287e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.158554 Jul 14 12:20:18.253430 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 154/300] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:18 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:18.849688 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9ff77240-fb3f-499b-8b90-e7a009babb96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:18.850356 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9ff77240-fb3f-499b-8b90-e7a009babb96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:18.856923 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9ff77240-fb3f-499b-8b90-e7a009babb96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:18.857371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9ff77240-fb3f-499b-8b90-e7a009babb96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:18.858138 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9ff77240-fb3f-499b-8b90-e7a009babb96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:18.858750 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9ff77240-fb3f-499b-8b90-e7a009babb96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:18.863486 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:19.024629 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9ff77240-fb3f-499b-8b90-e7a009babb96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:19.035251 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9ff77240-fb3f-499b-8b90-e7a009babb96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:19.038204 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9ff77240-fb3f-499b-8b90-e7a009babb96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:19.039603 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9ff77240-fb3f-499b-8b90-e7a009babb96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.193892 Jul 14 12:20:19.040571 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 147/301] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:18 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:19.268515 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e461f872-b8e6-4e67-8e05-8f7405c90e29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:19.269147 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e461f872-b8e6-4e67-8e05-8f7405c90e29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:19.276390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e461f872-b8e6-4e67-8e05-8f7405c90e29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:19.276898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e461f872-b8e6-4e67-8e05-8f7405c90e29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:19.277683 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e461f872-b8e6-4e67-8e05-8f7405c90e29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:19.278126 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e461f872-b8e6-4e67-8e05-8f7405c90e29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:19.427116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e461f872-b8e6-4e67-8e05-8f7405c90e29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:19.436070 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e461f872-b8e6-4e67-8e05-8f7405c90e29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.170899 Jul 14 12:20:19.438453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 155/302] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:19 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:20.058740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c7781c85-d439-4eee-8c1c-42ce238e830a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:20.059331 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c7781c85-d439-4eee-8c1c-42ce238e830a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:20.065804 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c7781c85-d439-4eee-8c1c-42ce238e830a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:20.066282 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c7781c85-d439-4eee-8c1c-42ce238e830a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:20.067076 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c7781c85-d439-4eee-8c1c-42ce238e830a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:20.067515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c7781c85-d439-4eee-8c1c-42ce238e830a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:20.205224 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c7781c85-d439-4eee-8c1c-42ce238e830a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:20.210927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c7781c85-d439-4eee-8c1c-42ce238e830a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:20.212517 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c7781c85-d439-4eee-8c1c-42ce238e830a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:20.214437 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c7781c85-d439-4eee-8c1c-42ce238e830a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.160257 Jul 14 12:20:20.215232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 148/303] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:20 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:20:20.272119 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-bba2cfbe-95cf-499f-99a2-a0cf30a0258b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bc12649-a0b5-493d-8aac-e16687ab09a8"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:20.274009 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-bba2cfbe-95cf-499f-99a2-a0cf30a0258b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:20.276932 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=4 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:20.282009 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bba2cfbe-95cf-499f-99a2-a0cf30a0258b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:20.282520 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bba2cfbe-95cf-499f-99a2-a0cf30a0258b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:20.283211 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bba2cfbe-95cf-499f-99a2-a0cf30a0258b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:20.283928 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bba2cfbe-95cf-499f-99a2-a0cf30a0258b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:20.459035 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-1bddaaca-b962-4827-a250-4fcf24a33d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:20.459658 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-1bddaaca-b962-4827-a250-4fcf24a33d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:20.469969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1bddaaca-b962-4827-a250-4fcf24a33d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:20.470642 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1bddaaca-b962-4827-a250-4fcf24a33d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:20.471530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1bddaaca-b962-4827-a250-4fcf24a33d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:20.472452 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1bddaaca-b962-4827-a250-4fcf24a33d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:20.731628 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1bddaaca-b962-4827-a250-4fcf24a33d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:20.744607 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-1bddaaca-b962-4827-a250-4fcf24a33d13 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.289174 Jul 14 12:20:20.745754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 149/304] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:20 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:20.928087 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-d137d4bd-c0fb-4c63-bb03-cd37501e20db req-309fb9cf-4781-481a-bfd2-d0c2536d9edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88a179-83e5-4361-8948-8a2632512eaf", "name": "network-vif-plugged", "status": "completed", "tag": "0091e22f-2f09-4a5d-9bd6-143e3f69992b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:20.943678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-d137d4bd-c0fb-4c63-bb03-cd37501e20db req-309fb9cf-4781-481a-bfd2-d0c2536d9edc service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:20.946266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-d137d4bd-c0fb-4c63-bb03-cd37501e20db req-309fb9cf-4781-481a-bfd2-d0c2536d9edc service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:20.963632 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-d137d4bd-c0fb-4c63-bb03-cd37501e20db req-309fb9cf-4781-481a-bfd2-d0c2536d9edc service nova] Creating event network-vif-plugged:0091e22f-2f09-4a5d-9bd6-143e3f69992b for instance 4d88a179-83e5-4361-8948-8a2632512eaf on hv-cinder-84890 Jul 14 12:20:20.969307 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-d137d4bd-c0fb-4c63-bb03-cd37501e20db req-309fb9cf-4781-481a-bfd2-d0c2536d9edc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044912 Jul 14 12:20:20.970476 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 150/305] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:20:21.133163 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:21.235313 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-773b6b20-0ea3-46a6-8a53-c790e72e02c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:21.236014 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-773b6b20-0ea3-46a6-8a53-c790e72e02c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:21.249350 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-773b6b20-0ea3-46a6-8a53-c790e72e02c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:21.259106 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-773b6b20-0ea3-46a6-8a53-c790e72e02c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:21.259106 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-773b6b20-0ea3-46a6-8a53-c790e72e02c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:21.259106 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-773b6b20-0ea3-46a6-8a53-c790e72e02c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:21.336270 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-bba2cfbe-95cf-499f-99a2-a0cf30a0258b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.067787 Jul 14 12:20:21.343763 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 156/306] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:20:20 2022] POST /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/os-volume_attachments => generated 194 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:20:21.677684 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-773b6b20-0ea3-46a6-8a53-c790e72e02c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:21.686814 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-773b6b20-0ea3-46a6-8a53-c790e72e02c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:21.688335 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-773b6b20-0ea3-46a6-8a53-c790e72e02c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:21.689440 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-773b6b20-0ea3-46a6-8a53-c790e72e02c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.459486 Jul 14 12:20:21.690380 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 151/307] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:21 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:21.763115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-37097e7f-8d2c-4efb-bcc4-da9ae2d1de76 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:21.763826 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-37097e7f-8d2c-4efb-bcc4-da9ae2d1de76 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:21.770258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-37097e7f-8d2c-4efb-bcc4-da9ae2d1de76 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:21.770738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-37097e7f-8d2c-4efb-bcc4-da9ae2d1de76 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:21.771569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-37097e7f-8d2c-4efb-bcc4-da9ae2d1de76 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:21.772027 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-37097e7f-8d2c-4efb-bcc4-da9ae2d1de76 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:21.937881 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-37097e7f-8d2c-4efb-bcc4-da9ae2d1de76 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:21.952998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-37097e7f-8d2c-4efb-bcc4-da9ae2d1de76 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.194905 Jul 14 12:20:21.967196 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 157/308] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:21 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:22.707747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2bb7b214-b5e0-4137-9ec9-25aa3657518c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:22.708359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2bb7b214-b5e0-4137-9ec9-25aa3657518c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:22.715980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2bb7b214-b5e0-4137-9ec9-25aa3657518c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:22.720152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2bb7b214-b5e0-4137-9ec9-25aa3657518c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:22.720152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2bb7b214-b5e0-4137-9ec9-25aa3657518c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:22.720152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2bb7b214-b5e0-4137-9ec9-25aa3657518c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:22.904581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2bb7b214-b5e0-4137-9ec9-25aa3657518c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:22.914523 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2bb7b214-b5e0-4137-9ec9-25aa3657518c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:22.919031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2bb7b214-b5e0-4137-9ec9-25aa3657518c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:22.919031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2bb7b214-b5e0-4137-9ec9-25aa3657518c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1407 microversion: 2.20 time: 0.214074 Jul 14 12:20:22.919031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 152/309] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:22 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:22.976738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a05f7cc5-f445-438a-ab0d-e4a2bdb87d51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:22.977436 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a05f7cc5-f445-438a-ab0d-e4a2bdb87d51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:22.985741 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a05f7cc5-f445-438a-ab0d-e4a2bdb87d51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:22.986622 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a05f7cc5-f445-438a-ab0d-e4a2bdb87d51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:22.987536 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a05f7cc5-f445-438a-ab0d-e4a2bdb87d51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:22.988360 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a05f7cc5-f445-438a-ab0d-e4a2bdb87d51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:23.212406 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a05f7cc5-f445-438a-ab0d-e4a2bdb87d51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:23.223656 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a05f7cc5-f445-438a-ab0d-e4a2bdb87d51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.250302 Jul 14 12:20:23.233861 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 158/310] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:22 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:23.938392 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-24451cd5-e7d1-4c9e-b0be-a5c3632e4bee tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:23.939065 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-24451cd5-e7d1-4c9e-b0be-a5c3632e4bee tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:23.945279 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:23.951404 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-24451cd5-e7d1-4c9e-b0be-a5c3632e4bee tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:23.952036 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-24451cd5-e7d1-4c9e-b0be-a5c3632e4bee tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:23.952956 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-24451cd5-e7d1-4c9e-b0be-a5c3632e4bee tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:23.953769 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-24451cd5-e7d1-4c9e-b0be-a5c3632e4bee tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:24.121234 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-24451cd5-e7d1-4c9e-b0be-a5c3632e4bee tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:24.130352 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-24451cd5-e7d1-4c9e-b0be-a5c3632e4bee tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:24.132013 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-24451cd5-e7d1-4c9e-b0be-a5c3632e4bee tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:24.133273 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-24451cd5-e7d1-4c9e-b0be-a5c3632e4bee tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1597 microversion: 2.20 time: 0.199074 Jul 14 12:20:24.133830 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 153/311] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:20:23 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1597 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:20:24.150310 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-64d16e73-fdc7-44a5-afce-d75d6a58841a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:24.151569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-64d16e73-fdc7-44a5-afce-d75d6a58841a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:24.161221 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-64d16e73-fdc7-44a5-afce-d75d6a58841a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:24.161666 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-64d16e73-fdc7-44a5-afce-d75d6a58841a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:24.162585 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-64d16e73-fdc7-44a5-afce-d75d6a58841a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:24.163060 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-64d16e73-fdc7-44a5-afce-d75d6a58841a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:24.244600 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-13cdeceb-4aa5-4eac-8f33-dfeb66883b01 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:24.245311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-13cdeceb-4aa5-4eac-8f33-dfeb66883b01 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:24.253910 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-64d16e73-fdc7-44a5-afce-d75d6a58841a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.107518 Jul 14 12:20:24.254490 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 159/312] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jul 14 12:20:24 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 12:20:24.255940 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-13cdeceb-4aa5-4eac-8f33-dfeb66883b01 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:24.256768 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-13cdeceb-4aa5-4eac-8f33-dfeb66883b01 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:24.258052 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-13cdeceb-4aa5-4eac-8f33-dfeb66883b01 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:24.258497 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-13cdeceb-4aa5-4eac-8f33-dfeb66883b01 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:24.500038 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-13cdeceb-4aa5-4eac-8f33-dfeb66883b01 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:24.511163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-13cdeceb-4aa5-4eac-8f33-dfeb66883b01 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.272618 Jul 14 12:20:24.512620 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 154/313] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:24 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:20:25.530670 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ae33a5c7-223b-4331-89de-d60ca2e9fad9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:25.532762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ae33a5c7-223b-4331-89de-d60ca2e9fad9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:25.550044 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ae33a5c7-223b-4331-89de-d60ca2e9fad9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:25.555887 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ae33a5c7-223b-4331-89de-d60ca2e9fad9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:25.557304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ae33a5c7-223b-4331-89de-d60ca2e9fad9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:25.560459 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ae33a5c7-223b-4331-89de-d60ca2e9fad9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:25.964431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ae33a5c7-223b-4331-89de-d60ca2e9fad9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:25.985497 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ae33a5c7-223b-4331-89de-d60ca2e9fad9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.448518 Jul 14 12:20:25.985497 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 160/314] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:25 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:26.381269 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-3f097506-8dac-464e-b8c9-6fed2fae3d5e req-69d36fd7-0eb1-49ed-953f-624ad29427ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d88a179-83e5-4361-8948-8a2632512eaf", "tag": "0091e22f-2f09-4a5d-9bd6-143e3f69992b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:26.397952 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-3f097506-8dac-464e-b8c9-6fed2fae3d5e req-69d36fd7-0eb1-49ed-953f-624ad29427ab service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:26.398657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-3f097506-8dac-464e-b8c9-6fed2fae3d5e req-69d36fd7-0eb1-49ed-953f-624ad29427ab service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:26.412432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-3f097506-8dac-464e-b8c9-6fed2fae3d5e req-69d36fd7-0eb1-49ed-953f-624ad29427ab service nova] Creating event network-changed:0091e22f-2f09-4a5d-9bd6-143e3f69992b for instance 4d88a179-83e5-4361-8948-8a2632512eaf on hv-cinder-84890 Jul 14 12:20:26.432528 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-3f097506-8dac-464e-b8c9-6fed2fae3d5e req-69d36fd7-0eb1-49ed-953f-624ad29427ab service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060350 Jul 14 12:20:26.439057 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 155/315] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:20:26.989470 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-130e1456-1c51-4689-8f90-7854115a8bb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:26.990594 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-130e1456-1c51-4689-8f90-7854115a8bb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:26.998481 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-130e1456-1c51-4689-8f90-7854115a8bb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:26.999031 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-130e1456-1c51-4689-8f90-7854115a8bb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:27.000021 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-130e1456-1c51-4689-8f90-7854115a8bb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:27.000839 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-130e1456-1c51-4689-8f90-7854115a8bb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:27.212938 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-130e1456-1c51-4689-8f90-7854115a8bb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:27.224521 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-130e1456-1c51-4689-8f90-7854115a8bb4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.238366 Jul 14 12:20:27.236721 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 161/316] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:26 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:28.242918 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bd03af8a-7804-4036-9169-b6f61c970fbf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:28.243617 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-bd03af8a-7804-4036-9169-b6f61c970fbf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:28.255130 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bd03af8a-7804-4036-9169-b6f61c970fbf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:28.259407 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bd03af8a-7804-4036-9169-b6f61c970fbf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:28.259407 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bd03af8a-7804-4036-9169-b6f61c970fbf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:28.259407 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bd03af8a-7804-4036-9169-b6f61c970fbf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:28.413701 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bd03af8a-7804-4036-9169-b6f61c970fbf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:28.423000 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bd03af8a-7804-4036-9169-b6f61c970fbf tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.184388 Jul 14 12:20:28.423564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 156/317] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:28 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:29.459504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-63adedb0-bb01-42b9-93b7-59f0615bed42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:29.461502 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-63adedb0-bb01-42b9-93b7-59f0615bed42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:29.481392 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:29.481392 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-63adedb0-bb01-42b9-93b7-59f0615bed42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:29.481392 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-63adedb0-bb01-42b9-93b7-59f0615bed42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:29.481392 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-63adedb0-bb01-42b9-93b7-59f0615bed42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:29.481877 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-63adedb0-bb01-42b9-93b7-59f0615bed42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:29.615679 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-63adedb0-bb01-42b9-93b7-59f0615bed42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:29.624754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-63adedb0-bb01-42b9-93b7-59f0615bed42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.187924 Jul 14 12:20:29.625447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 162/318] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:29 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:30.152065 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9c03cfff-5719-4da8-b3a9-451ed6aec34b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:30.159780 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9c03cfff-5719-4da8-b3a9-451ed6aec34b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:30.160221 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9c03cfff-5719-4da8-b3a9-451ed6aec34b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:30.226286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9c03cfff-5719-4da8-b3a9-451ed6aec34b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Going to try to stop instance {{(pid=118263) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 12:20:30.427179 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9c03cfff-5719-4da8-b3a9-451ed6aec34b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/action" status: 202 len: 0 microversion: 2.1 time: 0.281586 Jul 14 12:20:30.427816 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 157/319] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:20:30 2022] POST /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:20:30.444205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f587d57d-cfb0-4501-a308-8f958dca55b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:30.448684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f587d57d-cfb0-4501-a308-8f958dca55b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:30.459482 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f587d57d-cfb0-4501-a308-8f958dca55b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:30.459898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f587d57d-cfb0-4501-a308-8f958dca55b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:30.460745 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f587d57d-cfb0-4501-a308-8f958dca55b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:30.461220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f587d57d-cfb0-4501-a308-8f958dca55b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:30.638206 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f587d57d-cfb0-4501-a308-8f958dca55b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:30.642944 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d4e8c695-463d-438a-9842-2e2b04c59fb6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:30.644108 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d4e8c695-463d-438a-9842-2e2b04c59fb6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:30.647163 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f587d57d-cfb0-4501-a308-8f958dca55b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.214196 Jul 14 12:20:30.659397 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 163/320] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:30 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:30.661459 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d4e8c695-463d-438a-9842-2e2b04c59fb6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:30.662117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d4e8c695-463d-438a-9842-2e2b04c59fb6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:30.663104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d4e8c695-463d-438a-9842-2e2b04c59fb6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:30.663718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d4e8c695-463d-438a-9842-2e2b04c59fb6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:30.860514 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d4e8c695-463d-438a-9842-2e2b04c59fb6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:30.868537 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d4e8c695-463d-438a-9842-2e2b04c59fb6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.229875 Jul 14 12:20:30.869611 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 158/321] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:30 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:20:31.667920 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-22c955ce-21d9-476a-a850-c46d29e6f62f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:31.668496 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-22c955ce-21d9-476a-a850-c46d29e6f62f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:31.675316 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-22c955ce-21d9-476a-a850-c46d29e6f62f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:31.675760 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-22c955ce-21d9-476a-a850-c46d29e6f62f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:31.676722 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-22c955ce-21d9-476a-a850-c46d29e6f62f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:31.677165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-22c955ce-21d9-476a-a850-c46d29e6f62f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:31.826251 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-22c955ce-21d9-476a-a850-c46d29e6f62f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:31.834233 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-22c955ce-21d9-476a-a850-c46d29e6f62f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.171129 Jul 14 12:20:31.834808 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 164/322] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:31 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:31.898627 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-84648ca3-bf23-476c-b54b-efab2310cb69 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:31.900058 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-84648ca3-bf23-476c-b54b-efab2310cb69 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:31.907803 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84648ca3-bf23-476c-b54b-efab2310cb69 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:31.908471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84648ca3-bf23-476c-b54b-efab2310cb69 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:31.909823 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84648ca3-bf23-476c-b54b-efab2310cb69 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:31.910423 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84648ca3-bf23-476c-b54b-efab2310cb69 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:32.098280 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-84648ca3-bf23-476c-b54b-efab2310cb69 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:32.106700 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-84648ca3-bf23-476c-b54b-efab2310cb69 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.211848 Jul 14 12:20:32.116825 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 159/323] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:31 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:32.853526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ca23359f-4719-4e8d-82ad-3f5572b55a8e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:32.854264 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ca23359f-4719-4e8d-82ad-3f5572b55a8e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:32.861236 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca23359f-4719-4e8d-82ad-3f5572b55a8e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:32.862011 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca23359f-4719-4e8d-82ad-3f5572b55a8e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:32.862864 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca23359f-4719-4e8d-82ad-3f5572b55a8e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:32.863500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca23359f-4719-4e8d-82ad-3f5572b55a8e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:33.033890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ca23359f-4719-4e8d-82ad-3f5572b55a8e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:33.046519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ca23359f-4719-4e8d-82ad-3f5572b55a8e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.196045 Jul 14 12:20:33.048815 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 165/324] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:32 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:33.126084 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3e838ef9-1d5a-457e-a93a-1935b75bfed5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:33.126797 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3e838ef9-1d5a-457e-a93a-1935b75bfed5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:33.134152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e838ef9-1d5a-457e-a93a-1935b75bfed5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:33.135546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e838ef9-1d5a-457e-a93a-1935b75bfed5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:33.136565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e838ef9-1d5a-457e-a93a-1935b75bfed5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:33.137280 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e838ef9-1d5a-457e-a93a-1935b75bfed5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:33.319209 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3e838ef9-1d5a-457e-a93a-1935b75bfed5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:33.328969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3e838ef9-1d5a-457e-a93a-1935b75bfed5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.207926 Jul 14 12:20:33.339126 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 160/325] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:33 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:34.064564 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-81c3c4d8-a5ae-4108-bbbd-b688813e7139 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:34.065253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-81c3c4d8-a5ae-4108-bbbd-b688813e7139 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:34.084736 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-81c3c4d8-a5ae-4108-bbbd-b688813e7139 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:34.085452 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-81c3c4d8-a5ae-4108-bbbd-b688813e7139 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:34.086510 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-81c3c4d8-a5ae-4108-bbbd-b688813e7139 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:34.087177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-81c3c4d8-a5ae-4108-bbbd-b688813e7139 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:34.276224 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-81c3c4d8-a5ae-4108-bbbd-b688813e7139 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:34.285497 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-81c3c4d8-a5ae-4108-bbbd-b688813e7139 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.225145 Jul 14 12:20:34.286150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 166/326] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:34 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:34.345768 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c9de27fb-ba81-460f-9930-71af6b6a1a4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:34.346598 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c9de27fb-ba81-460f-9930-71af6b6a1a4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:34.354120 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c9de27fb-ba81-460f-9930-71af6b6a1a4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:34.358441 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c9de27fb-ba81-460f-9930-71af6b6a1a4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:34.358441 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c9de27fb-ba81-460f-9930-71af6b6a1a4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:34.358441 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c9de27fb-ba81-460f-9930-71af6b6a1a4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:34.515581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c9de27fb-ba81-460f-9930-71af6b6a1a4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:34.526300 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c9de27fb-ba81-460f-9930-71af6b6a1a4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.183641 Jul 14 12:20:34.526957 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 161/327] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:34 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:35.303790 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2b12af41-57bf-4fec-b927-4dfbdd1f482d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:35.305061 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2b12af41-57bf-4fec-b927-4dfbdd1f482d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:35.314945 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b12af41-57bf-4fec-b927-4dfbdd1f482d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:35.315403 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b12af41-57bf-4fec-b927-4dfbdd1f482d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:35.316260 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b12af41-57bf-4fec-b927-4dfbdd1f482d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:35.316775 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b12af41-57bf-4fec-b927-4dfbdd1f482d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:35.452227 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2b12af41-57bf-4fec-b927-4dfbdd1f482d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:35.460265 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2b12af41-57bf-4fec-b927-4dfbdd1f482d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.160846 Jul 14 12:20:35.461044 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 167/328] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:35 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:20:35.551791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0484ecca-b50f-4f7c-8488-c486993be252 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:35.557492 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0484ecca-b50f-4f7c-8488-c486993be252 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:35.575448 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0484ecca-b50f-4f7c-8488-c486993be252 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:35.582787 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0484ecca-b50f-4f7c-8488-c486993be252 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:35.583747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0484ecca-b50f-4f7c-8488-c486993be252 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:35.584243 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0484ecca-b50f-4f7c-8488-c486993be252 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:35.826853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0484ecca-b50f-4f7c-8488-c486993be252 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:35.836589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0484ecca-b50f-4f7c-8488-c486993be252 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.296865 Jul 14 12:20:35.837259 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 162/329] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:35 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:20:36.477523 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ac9da544-e5e8-4a5d-b8fa-2b1f3f872caf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:36.478132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ac9da544-e5e8-4a5d-b8fa-2b1f3f872caf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:36.486109 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ac9da544-e5e8-4a5d-b8fa-2b1f3f872caf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:36.486880 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ac9da544-e5e8-4a5d-b8fa-2b1f3f872caf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:36.487989 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ac9da544-e5e8-4a5d-b8fa-2b1f3f872caf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:36.488680 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ac9da544-e5e8-4a5d-b8fa-2b1f3f872caf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:36.677725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ac9da544-e5e8-4a5d-b8fa-2b1f3f872caf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:36.687340 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ac9da544-e5e8-4a5d-b8fa-2b1f3f872caf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.213401 Jul 14 12:20:36.688379 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 168/330] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:36 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:36.856330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-11516a73-3648-4a22-a5d2-8ce3899100f8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:36.856962 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-11516a73-3648-4a22-a5d2-8ce3899100f8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:36.863886 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-11516a73-3648-4a22-a5d2-8ce3899100f8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:36.864336 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-11516a73-3648-4a22-a5d2-8ce3899100f8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:36.865105 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-11516a73-3648-4a22-a5d2-8ce3899100f8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:36.865647 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-11516a73-3648-4a22-a5d2-8ce3899100f8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:37.010314 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-11516a73-3648-4a22-a5d2-8ce3899100f8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:37.018267 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-11516a73-3648-4a22-a5d2-8ce3899100f8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.167396 Jul 14 12:20:37.018985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 163/331] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:36 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:37.714651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6244f2fa-1015-42f3-993c-bf9aa1b221ad tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:37.714651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6244f2fa-1015-42f3-993c-bf9aa1b221ad tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:37.714651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6244f2fa-1015-42f3-993c-bf9aa1b221ad tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:37.714651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6244f2fa-1015-42f3-993c-bf9aa1b221ad tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:37.715546 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6244f2fa-1015-42f3-993c-bf9aa1b221ad tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:37.715546 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6244f2fa-1015-42f3-993c-bf9aa1b221ad tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:37.853075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6244f2fa-1015-42f3-993c-bf9aa1b221ad tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:37.862720 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6244f2fa-1015-42f3-993c-bf9aa1b221ad tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.162014 Jul 14 12:20:37.863321 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 169/332] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:37 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:38.035360 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bf3aa497-766d-485a-8056-eae6cbdaca94 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:38.036073 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-bf3aa497-766d-485a-8056-eae6cbdaca94 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:38.042901 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf3aa497-766d-485a-8056-eae6cbdaca94 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:38.043417 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf3aa497-766d-485a-8056-eae6cbdaca94 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:38.044330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf3aa497-766d-485a-8056-eae6cbdaca94 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:38.044760 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf3aa497-766d-485a-8056-eae6cbdaca94 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:38.049298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:38.212091 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bf3aa497-766d-485a-8056-eae6cbdaca94 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:38.220539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bf3aa497-766d-485a-8056-eae6cbdaca94 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.189163 Jul 14 12:20:38.221143 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 164/333] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:38 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:38.879716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8a066f52-0d15-4e32-bfa8-3662bb08c6e4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:38.880297 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8a066f52-0d15-4e32-bfa8-3662bb08c6e4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:38.886926 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8a066f52-0d15-4e32-bfa8-3662bb08c6e4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:38.887379 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8a066f52-0d15-4e32-bfa8-3662bb08c6e4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:38.888280 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8a066f52-0d15-4e32-bfa8-3662bb08c6e4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:38.888727 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8a066f52-0d15-4e32-bfa8-3662bb08c6e4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:39.025936 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8a066f52-0d15-4e32-bfa8-3662bb08c6e4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:39.031038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8a066f52-0d15-4e32-bfa8-3662bb08c6e4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.155200 Jul 14 12:20:39.031694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 170/334] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:38 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:39.237987 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-52ecf0db-7f3f-4585-8a26-81b6577ed35d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:39.238609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-52ecf0db-7f3f-4585-8a26-81b6577ed35d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:39.246076 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-52ecf0db-7f3f-4585-8a26-81b6577ed35d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:39.246522 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-52ecf0db-7f3f-4585-8a26-81b6577ed35d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:39.247367 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-52ecf0db-7f3f-4585-8a26-81b6577ed35d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:39.247988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-52ecf0db-7f3f-4585-8a26-81b6577ed35d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:39.392388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-52ecf0db-7f3f-4585-8a26-81b6577ed35d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:39.400315 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-52ecf0db-7f3f-4585-8a26-81b6577ed35d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.166559 Jul 14 12:20:39.410442 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 165/335] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:39 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:40.048365 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2465018b-31de-4a4c-9239-f4eb99201a94 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:40.048903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2465018b-31de-4a4c-9239-f4eb99201a94 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:40.055633 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2465018b-31de-4a4c-9239-f4eb99201a94 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:40.058355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2465018b-31de-4a4c-9239-f4eb99201a94 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:40.058355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2465018b-31de-4a4c-9239-f4eb99201a94 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:40.058355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2465018b-31de-4a4c-9239-f4eb99201a94 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:40.230577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2465018b-31de-4a4c-9239-f4eb99201a94 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:40.240350 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2465018b-31de-4a4c-9239-f4eb99201a94 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.195972 Jul 14 12:20:40.240935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 171/336] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:40 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:40.419951 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-317bbc3a-efed-4827-b62f-28780f80031b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:40.422532 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-317bbc3a-efed-4827-b62f-28780f80031b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:40.431336 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-317bbc3a-efed-4827-b62f-28780f80031b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:40.432832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-317bbc3a-efed-4827-b62f-28780f80031b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:40.433851 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-317bbc3a-efed-4827-b62f-28780f80031b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:40.434308 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-317bbc3a-efed-4827-b62f-28780f80031b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:40.540598 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-111546964", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-70849047", "security_groups": [{"name": "tempest-secgroup-smoke-796876877"}], "networks": [{"uuid": "2e2d82ad-097f-449f-ba1a-eddfae1d0196"}], "block_device_mapping_v2": [{"uuid": "d3cd3730-9c02-4ee9-85b8-80dd7c9c41dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:40.629270 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-317bbc3a-efed-4827-b62f-28780f80031b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:40.646679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-317bbc3a-efed-4827-b62f-28780f80031b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.227559 Jul 14 12:20:40.662820 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 166/337] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:40 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:40.779205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.network.neutron [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] validate_networks() for [('2e2d82ad-097f-449f-ba1a-eddfae1d0196', None, None, None, None, None)] {{(pid=118262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:20:41.256428 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Flavor limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:20:41.259472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Image limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:20:41.259472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Flavor pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:20:41.259472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Image pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:20:41.259472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:20:41.260384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a403f154-74fe-45d9-a202-94b7810bcae3 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:41.261991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a403f154-74fe-45d9-a202-94b7810bcae3 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:41.272698 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a403f154-74fe-45d9-a202-94b7810bcae3 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:41.273151 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a403f154-74fe-45d9-a202-94b7810bcae3 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:41.274614 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a403f154-74fe-45d9-a202-94b7810bcae3 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:41.278054 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:41.278686 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:41.280307 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:41.281026 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:41.287170 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a403f154-74fe-45d9-a202-94b7810bcae3 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:41.302074 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Getting quotas for project dfa18dfa445442d4be02d187ed24325f. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:20:41.307736 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Getting quotas for user 7489ed79115044388225314714876f24 and project dfa18dfa445442d4be02d187ed24325f. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:20:41.374392 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Going to run 1 instances... {{(pid=118262) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:20:41.376770 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d3cd3730-9c02-4ee9-85b8-80dd7c9c41dd',volume_size=None,volume_type=None)] {{(pid=118262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:20:41.544382 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a403f154-74fe-45d9-a202-94b7810bcae3 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:41.554348 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a403f154-74fe-45d9-a202-94b7810bcae3 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.300102 Jul 14 12:20:41.564715 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 167/338] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:41 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:41.666748 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-24fea2c3-27fa-496f-a2e4-bfaa3b8551b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:41.667703 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-24fea2c3-27fa-496f-a2e4-bfaa3b8551b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:41.674307 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-24fea2c3-27fa-496f-a2e4-bfaa3b8551b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:41.676459 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-24fea2c3-27fa-496f-a2e4-bfaa3b8551b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:41.676459 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-24fea2c3-27fa-496f-a2e4-bfaa3b8551b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:41.676459 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-24fea2c3-27fa-496f-a2e4-bfaa3b8551b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:41.874058 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-91804c5b-3021-4302-87e5-30d271f4c759 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.337019 Jul 14 12:20:41.874546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-24fea2c3-27fa-496f-a2e4-bfaa3b8551b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:41.875551 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 172/339] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:20:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 1339 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:20:41.890202 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-900badaa-676c-48a7-a0ef-4dcd59486675 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:41.891276 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-900badaa-676c-48a7-a0ef-4dcd59486675 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:41.919704 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-24fea2c3-27fa-496f-a2e4-bfaa3b8551b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.245292 Jul 14 12:20:41.923242 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 168/340] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:41 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:41.992804 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-900badaa-676c-48a7-a0ef-4dcd59486675 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:42.005267 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-900badaa-676c-48a7-a0ef-4dcd59486675 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1086 microversion: 2.1 time: 0.122617 Jul 14 12:20:42.006171 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 173/341] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:41 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1086 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:42.571993 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-47e430fa-c1a2-4b04-8a04-36536c5ba7e6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:42.572731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-47e430fa-c1a2-4b04-8a04-36536c5ba7e6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:42.579839 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47e430fa-c1a2-4b04-8a04-36536c5ba7e6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:42.580306 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47e430fa-c1a2-4b04-8a04-36536c5ba7e6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:42.581322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47e430fa-c1a2-4b04-8a04-36536c5ba7e6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:42.581928 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47e430fa-c1a2-4b04-8a04-36536c5ba7e6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:42.757234 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-47e430fa-c1a2-4b04-8a04-36536c5ba7e6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:42.765917 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-47e430fa-c1a2-4b04-8a04-36536c5ba7e6 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.197867 Jul 14 12:20:42.783449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 169/342] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:42 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:42.940532 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f6aa8527-ea9f-4971-bf24-0f13cd4f7be6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:42.942173 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f6aa8527-ea9f-4971-bf24-0f13cd4f7be6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:42.949360 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f6aa8527-ea9f-4971-bf24-0f13cd4f7be6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:42.949885 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f6aa8527-ea9f-4971-bf24-0f13cd4f7be6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:42.950662 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f6aa8527-ea9f-4971-bf24-0f13cd4f7be6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:42.951122 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f6aa8527-ea9f-4971-bf24-0f13cd4f7be6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:43.027870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-1802627b-628b-4098-84ae-ac87ea7435fa tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:43.028553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-1802627b-628b-4098-84ae-ac87ea7435fa tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:43.096960 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1802627b-628b-4098-84ae-ac87ea7435fa tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:43.107809 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-1802627b-628b-4098-84ae-ac87ea7435fa tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1086 microversion: 2.1 time: 0.084917 Jul 14 12:20:43.108930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 170/343] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:43 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1086 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:20:43.251434 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f6aa8527-ea9f-4971-bf24-0f13cd4f7be6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:43.255063 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:43.261842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f6aa8527-ea9f-4971-bf24-0f13cd4f7be6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.325019 Jul 14 12:20:43.262987 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 174/344] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:42 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:43.785302 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ea9686e8-4ece-4a8f-b5a9-c49807f39e19 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:43.786050 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ea9686e8-4ece-4a8f-b5a9-c49807f39e19 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:43.793719 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ea9686e8-4ece-4a8f-b5a9-c49807f39e19 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:43.797387 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ea9686e8-4ece-4a8f-b5a9-c49807f39e19 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:43.797387 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ea9686e8-4ece-4a8f-b5a9-c49807f39e19 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:43.797387 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ea9686e8-4ece-4a8f-b5a9-c49807f39e19 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:43.986794 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ea9686e8-4ece-4a8f-b5a9-c49807f39e19 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:43.995479 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ea9686e8-4ece-4a8f-b5a9-c49807f39e19 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.213964 Jul 14 12:20:43.996094 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 171/345] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:43 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:44.127589 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ba165e70-27a5-4b2f-b9da-92b2b6ebc3c0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:44.128007 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ba165e70-27a5-4b2f-b9da-92b2b6ebc3c0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:44.138574 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ba165e70-27a5-4b2f-b9da-92b2b6ebc3c0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:44.139070 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ba165e70-27a5-4b2f-b9da-92b2b6ebc3c0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:44.139865 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ba165e70-27a5-4b2f-b9da-92b2b6ebc3c0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:44.140305 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ba165e70-27a5-4b2f-b9da-92b2b6ebc3c0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:44.219679 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ba165e70-27a5-4b2f-b9da-92b2b6ebc3c0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:44.231332 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ba165e70-27a5-4b2f-b9da-92b2b6ebc3c0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1184 microversion: 2.1 time: 0.107900 Jul 14 12:20:44.232295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 175/346] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:44 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1184 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:44.294869 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c0c8b5dd-f466-49bf-8cea-7539a0dc8e26 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:44.294869 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c0c8b5dd-f466-49bf-8cea-7539a0dc8e26 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:44.294869 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0c8b5dd-f466-49bf-8cea-7539a0dc8e26 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:44.294869 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0c8b5dd-f466-49bf-8cea-7539a0dc8e26 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:44.295180 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0c8b5dd-f466-49bf-8cea-7539a0dc8e26 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:44.295180 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0c8b5dd-f466-49bf-8cea-7539a0dc8e26 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:44.502728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c0c8b5dd-f466-49bf-8cea-7539a0dc8e26 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:44.514564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c0c8b5dd-f466-49bf-8cea-7539a0dc8e26 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.238997 Jul 14 12:20:44.524114 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 172/347] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:44 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:45.012509 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a06c3141-0cc7-42e3-adfb-cc0a28cac64d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:45.013106 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a06c3141-0cc7-42e3-adfb-cc0a28cac64d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:45.019970 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a06c3141-0cc7-42e3-adfb-cc0a28cac64d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:45.034075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a06c3141-0cc7-42e3-adfb-cc0a28cac64d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:45.035234 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a06c3141-0cc7-42e3-adfb-cc0a28cac64d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:45.035820 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a06c3141-0cc7-42e3-adfb-cc0a28cac64d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:45.199495 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a06c3141-0cc7-42e3-adfb-cc0a28cac64d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:45.212667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a06c3141-0cc7-42e3-adfb-cc0a28cac64d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.202912 Jul 14 12:20:45.214419 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 176/348] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:45 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:45.251434 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-89f55e6d-681d-48be-a07c-e9e0386718fe tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:45.252271 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-89f55e6d-681d-48be-a07c-e9e0386718fe tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:45.267153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-89f55e6d-681d-48be-a07c-e9e0386718fe tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:45.267747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-89f55e6d-681d-48be-a07c-e9e0386718fe tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:45.268815 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-89f55e6d-681d-48be-a07c-e9e0386718fe tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:45.269458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-89f55e6d-681d-48be-a07c-e9e0386718fe tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:45.531733 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3aec3836-9c49-4325-9fd6-d848636af457 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:45.532352 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3aec3836-9c49-4325-9fd6-d848636af457 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:45.538940 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3aec3836-9c49-4325-9fd6-d848636af457 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:45.540581 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3aec3836-9c49-4325-9fd6-d848636af457 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:45.553031 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3aec3836-9c49-4325-9fd6-d848636af457 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:45.554585 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3aec3836-9c49-4325-9fd6-d848636af457 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:45.716560 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-89f55e6d-681d-48be-a07c-e9e0386718fe tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:45.731653 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-89f55e6d-681d-48be-a07c-e9e0386718fe tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1202 microversion: 2.1 time: 0.484993 Jul 14 12:20:45.732535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 173/349] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:45 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1202 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:45.770060 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3aec3836-9c49-4325-9fd6-d848636af457 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:45.780608 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3aec3836-9c49-4325-9fd6-d848636af457 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.252737 Jul 14 12:20:45.783123 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 177/350] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:45 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:20:46.229484 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a4ab5ba5-d444-4300-baf8-d125f06a1fe5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:46.250989 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a4ab5ba5-d444-4300-baf8-d125f06a1fe5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:46.250989 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4ab5ba5-d444-4300-baf8-d125f06a1fe5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:46.250989 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4ab5ba5-d444-4300-baf8-d125f06a1fe5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:46.250989 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4ab5ba5-d444-4300-baf8-d125f06a1fe5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:46.251955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4ab5ba5-d444-4300-baf8-d125f06a1fe5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:46.721130 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a4ab5ba5-d444-4300-baf8-d125f06a1fe5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:46.734844 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a4ab5ba5-d444-4300-baf8-d125f06a1fe5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1720 microversion: 2.1 time: 0.509099 Jul 14 12:20:46.753558 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6d2cedda-21b0-4f72-b87f-ba0ca83bad0f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:46.754817 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6d2cedda-21b0-4f72-b87f-ba0ca83bad0f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:46.761697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 174/351] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:46 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1720 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:46.766710 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6d2cedda-21b0-4f72-b87f-ba0ca83bad0f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:46.772677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6d2cedda-21b0-4f72-b87f-ba0ca83bad0f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:46.772677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6d2cedda-21b0-4f72-b87f-ba0ca83bad0f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:46.772677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6d2cedda-21b0-4f72-b87f-ba0ca83bad0f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:46.801587 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3bef1d83-dd05-458a-b0ac-40ba9db10823 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:46.801587 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3bef1d83-dd05-458a-b0ac-40ba9db10823 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:46.809402 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3bef1d83-dd05-458a-b0ac-40ba9db10823 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:46.813739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3bef1d83-dd05-458a-b0ac-40ba9db10823 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:46.814849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3bef1d83-dd05-458a-b0ac-40ba9db10823 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:46.815956 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3bef1d83-dd05-458a-b0ac-40ba9db10823 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:46.897221 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6d2cedda-21b0-4f72-b87f-ba0ca83bad0f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:46.906092 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6d2cedda-21b0-4f72-b87f-ba0ca83bad0f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1202 microversion: 2.1 time: 0.156351 Jul 14 12:20:46.915527 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 178/352] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:46 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1202 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:47.160796 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3bef1d83-dd05-458a-b0ac-40ba9db10823 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:47.168192 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3bef1d83-dd05-458a-b0ac-40ba9db10823 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.374069 Jul 14 12:20:47.169206 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 175/353] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:46 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:47.756102 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-aede324a-6ca8-4f76-97c5-98ff8511657e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:47.757299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-aede324a-6ca8-4f76-97c5-98ff8511657e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:47.766143 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-aede324a-6ca8-4f76-97c5-98ff8511657e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:47.767045 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-aede324a-6ca8-4f76-97c5-98ff8511657e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:47.767998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-aede324a-6ca8-4f76-97c5-98ff8511657e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:47.768578 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-aede324a-6ca8-4f76-97c5-98ff8511657e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:47.937956 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8a1cecf1-ce68-4117-95b7-57c885126800 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:47.939618 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8a1cecf1-ce68-4117-95b7-57c885126800 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:47.957730 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a1cecf1-ce68-4117-95b7-57c885126800 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:47.962366 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a1cecf1-ce68-4117-95b7-57c885126800 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:47.962366 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a1cecf1-ce68-4117-95b7-57c885126800 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:47.962366 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a1cecf1-ce68-4117-95b7-57c885126800 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:48.005074 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-aede324a-6ca8-4f76-97c5-98ff8511657e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:48.019705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-aede324a-6ca8-4f76-97c5-98ff8511657e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1697 microversion: 2.1 time: 0.267208 Jul 14 12:20:48.021650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 179/354] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:47 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1697 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:48.066442 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c720e461-e3fd-49e7-ae58-f29cc90012fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:48.083083 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c720e461-e3fd-49e7-ae58-f29cc90012fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:48.086993 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c720e461-e3fd-49e7-ae58-f29cc90012fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:48.194474 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c720e461-e3fd-49e7-ae58-f29cc90012fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Going to try to start instance {{(pid=118262) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 12:20:48.328240 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8a1cecf1-ce68-4117-95b7-57c885126800 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:48.344719 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8a1cecf1-ce68-4117-95b7-57c885126800 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.406830 Jul 14 12:20:48.355994 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 176/355] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:47 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:20:48.373185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-47192ab4-0845-42cc-8557-ae345935887c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:48.373185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-47192ab4-0845-42cc-8557-ae345935887c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:48.374196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47192ab4-0845-42cc-8557-ae345935887c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:48.374643 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47192ab4-0845-42cc-8557-ae345935887c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:48.375828 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47192ab4-0845-42cc-8557-ae345935887c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:48.376457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47192ab4-0845-42cc-8557-ae345935887c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:48.392987 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c720e461-e3fd-49e7-ae58-f29cc90012fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/action" status: 202 len: 0 microversion: 2.1 time: 0.347962 Jul 14 12:20:48.393934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 180/356] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:20:48 2022] POST /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:20:48.408621 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b2055477-7b28-4414-9476-8c9f3d168ffa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:48.413066 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b2055477-7b28-4414-9476-8c9f3d168ffa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:48.427645 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2055477-7b28-4414-9476-8c9f3d168ffa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:48.430489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2055477-7b28-4414-9476-8c9f3d168ffa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:48.433207 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2055477-7b28-4414-9476-8c9f3d168ffa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:48.436399 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2055477-7b28-4414-9476-8c9f3d168ffa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:48.680068 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b2055477-7b28-4414-9476-8c9f3d168ffa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:48.695798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b2055477-7b28-4414-9476-8c9f3d168ffa tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1706 microversion: 2.1 time: 0.297284 Jul 14 12:20:48.711545 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 181/357] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:48 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1706 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:49.344618 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-47192ab4-0845-42cc-8557-ae345935887c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:49.353125 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-47192ab4-0845-42cc-8557-ae345935887c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.995700 Jul 14 12:20:49.356199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 177/358] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:48 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:49.364505 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0e26b76d-4dfb-497d-9261-8e2a799d071f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:49.366001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0e26b76d-4dfb-497d-9261-8e2a799d071f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:49.389493 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0e26b76d-4dfb-497d-9261-8e2a799d071f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:49.389731 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0e26b76d-4dfb-497d-9261-8e2a799d071f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:49.390575 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0e26b76d-4dfb-497d-9261-8e2a799d071f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:49.391180 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0e26b76d-4dfb-497d-9261-8e2a799d071f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:49.601429 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0e26b76d-4dfb-497d-9261-8e2a799d071f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:49.610451 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0e26b76d-4dfb-497d-9261-8e2a799d071f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.252665 Jul 14 12:20:49.621600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 182/359] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:49 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:49.716185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e0af435d-f1d8-4142-8c95-e724dec9ffb8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:49.716185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e0af435d-f1d8-4142-8c95-e724dec9ffb8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:49.723533 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e0af435d-f1d8-4142-8c95-e724dec9ffb8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:49.723981 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e0af435d-f1d8-4142-8c95-e724dec9ffb8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:49.724753 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e0af435d-f1d8-4142-8c95-e724dec9ffb8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:49.725188 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e0af435d-f1d8-4142-8c95-e724dec9ffb8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:50.195683 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e0af435d-f1d8-4142-8c95-e724dec9ffb8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:50.208908 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e0af435d-f1d8-4142-8c95-e724dec9ffb8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1706 microversion: 2.1 time: 0.499012 Jul 14 12:20:50.210289 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 178/360] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:49 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1706 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:50.292875 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-8f60fedb-33f5-42ea-b55b-dd64d9162a1a req-c2763952-95d3-403d-8d88-b2c37ae12c0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "905d8954-a633-4e05-a5eb-1bd833799fea", "tag": "97573f11-1cde-45f1-8103-8f5b45ac6f97"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:50.309250 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-8f60fedb-33f5-42ea-b55b-dd64d9162a1a req-c2763952-95d3-403d-8d88-b2c37ae12c0a service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:50.319286 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-8f60fedb-33f5-42ea-b55b-dd64d9162a1a req-c2763952-95d3-403d-8d88-b2c37ae12c0a service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:50.332641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-8f60fedb-33f5-42ea-b55b-dd64d9162a1a req-c2763952-95d3-403d-8d88-b2c37ae12c0a service nova] Creating event network-changed:97573f11-1cde-45f1-8103-8f5b45ac6f97 for instance 905d8954-a633-4e05-a5eb-1bd833799fea on hv-cinder-84890 Jul 14 12:20:50.355114 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-8f60fedb-33f5-42ea-b55b-dd64d9162a1a req-c2763952-95d3-403d-8d88-b2c37ae12c0a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052292 Jul 14 12:20:50.356384 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 183/361] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:20:50.375538 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-42182f7c-ff60-46ad-8a7f-f91f6dbf8a02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:50.377045 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-42182f7c-ff60-46ad-8a7f-f91f6dbf8a02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:50.389787 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42182f7c-ff60-46ad-8a7f-f91f6dbf8a02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:50.391739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42182f7c-ff60-46ad-8a7f-f91f6dbf8a02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:50.393518 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42182f7c-ff60-46ad-8a7f-f91f6dbf8a02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:50.394862 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42182f7c-ff60-46ad-8a7f-f91f6dbf8a02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:50.652562 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ca8e9844-8a65-48b7-985b-3646a18815f0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:50.654844 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ca8e9844-8a65-48b7-985b-3646a18815f0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:50.663367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca8e9844-8a65-48b7-985b-3646a18815f0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:50.663815 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca8e9844-8a65-48b7-985b-3646a18815f0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:50.664745 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca8e9844-8a65-48b7-985b-3646a18815f0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:50.665339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca8e9844-8a65-48b7-985b-3646a18815f0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:50.830052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ca8e9844-8a65-48b7-985b-3646a18815f0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:50.838220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ca8e9844-8a65-48b7-985b-3646a18815f0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.197504 Jul 14 12:20:50.841292 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 184/362] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:50 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:50.920152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-42182f7c-ff60-46ad-8a7f-f91f6dbf8a02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:50.941455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-42182f7c-ff60-46ad-8a7f-f91f6dbf8a02 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.570995 Jul 14 12:20:50.943164 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 179/363] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:50 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:51.227888 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-914923da-d188-4e5e-bb36-fbddd614b302 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:51.228695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-914923da-d188-4e5e-bb36-fbddd614b302 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:51.235867 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-914923da-d188-4e5e-bb36-fbddd614b302 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:51.236453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-914923da-d188-4e5e-bb36-fbddd614b302 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:51.237245 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-914923da-d188-4e5e-bb36-fbddd614b302 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:51.237754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-914923da-d188-4e5e-bb36-fbddd614b302 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:51.292255 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:51.396430 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-914923da-d188-4e5e-bb36-fbddd614b302 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:51.405192 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-914923da-d188-4e5e-bb36-fbddd614b302 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1706 microversion: 2.1 time: 0.181407 Jul 14 12:20:51.405777 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 185/364] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:51 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1706 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:51.858797 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a8c23dbb-e4cf-43b5-a4d4-df3488663a73 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:51.863182 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a8c23dbb-e4cf-43b5-a4d4-df3488663a73 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:51.870551 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8c23dbb-e4cf-43b5-a4d4-df3488663a73 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:51.871236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8c23dbb-e4cf-43b5-a4d4-df3488663a73 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:51.872236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8c23dbb-e4cf-43b5-a4d4-df3488663a73 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:51.872746 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8c23dbb-e4cf-43b5-a4d4-df3488663a73 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:51.961234 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-479d3244-cbcd-485d-a098-66dfe52c5998 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:51.961885 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-479d3244-cbcd-485d-a098-66dfe52c5998 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:51.972970 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-479d3244-cbcd-485d-a098-66dfe52c5998 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:51.973590 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-479d3244-cbcd-485d-a098-66dfe52c5998 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:51.974370 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-479d3244-cbcd-485d-a098-66dfe52c5998 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:51.975017 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-479d3244-cbcd-485d-a098-66dfe52c5998 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:52.000250 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=8 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:52.064757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a8c23dbb-e4cf-43b5-a4d4-df3488663a73 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:52.078070 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a8c23dbb-e4cf-43b5-a4d4-df3488663a73 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.223191 Jul 14 12:20:52.088541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 180/365] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:51 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:52.138033 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-479d3244-cbcd-485d-a098-66dfe52c5998 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:52.147686 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-479d3244-cbcd-485d-a098-66dfe52c5998 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.191122 Jul 14 12:20:52.148779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 186/366] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:51 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:52.423579 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2eeeb06b-1670-4d32-a8b1-ed69b1b63858 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:52.424198 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2eeeb06b-1670-4d32-a8b1-ed69b1b63858 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:52.432685 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2eeeb06b-1670-4d32-a8b1-ed69b1b63858 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:52.433363 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2eeeb06b-1670-4d32-a8b1-ed69b1b63858 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:52.434143 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2eeeb06b-1670-4d32-a8b1-ed69b1b63858 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:52.434579 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2eeeb06b-1670-4d32-a8b1-ed69b1b63858 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:52.638693 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2eeeb06b-1670-4d32-a8b1-ed69b1b63858 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:52.642274 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:52.647702 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2eeeb06b-1670-4d32-a8b1-ed69b1b63858 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1706 microversion: 2.1 time: 0.228750 Jul 14 12:20:52.648291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 181/367] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:52 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1706 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:53.095126 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b62e7fb6-ed90-443e-8997-2ece6bfb7d6d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:53.095887 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b62e7fb6-ed90-443e-8997-2ece6bfb7d6d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:53.102472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b62e7fb6-ed90-443e-8997-2ece6bfb7d6d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:53.103574 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b62e7fb6-ed90-443e-8997-2ece6bfb7d6d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:53.104745 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b62e7fb6-ed90-443e-8997-2ece6bfb7d6d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:53.105254 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b62e7fb6-ed90-443e-8997-2ece6bfb7d6d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:53.170450 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a06d6fdd-1e4a-4cbf-8148-4e3a72ccc68e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:53.171358 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a06d6fdd-1e4a-4cbf-8148-4e3a72ccc68e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:53.174199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:53.180020 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a06d6fdd-1e4a-4cbf-8148-4e3a72ccc68e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:53.180791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a06d6fdd-1e4a-4cbf-8148-4e3a72ccc68e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:53.182500 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a06d6fdd-1e4a-4cbf-8148-4e3a72ccc68e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:53.183145 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a06d6fdd-1e4a-4cbf-8148-4e3a72ccc68e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:53.289189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b62e7fb6-ed90-443e-8997-2ece6bfb7d6d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:53.305368 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b62e7fb6-ed90-443e-8997-2ece6bfb7d6d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.214044 Jul 14 12:20:53.307456 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 187/368] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:53 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:53.443218 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a06d6fdd-1e4a-4cbf-8148-4e3a72ccc68e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:53.452848 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a06d6fdd-1e4a-4cbf-8148-4e3a72ccc68e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.291245 Jul 14 12:20:53.453624 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 182/369] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:53 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:53.665269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cfa1be11-9af7-4c31-9253-b69be1ba0210 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:53.666159 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-cfa1be11-9af7-4c31-9253-b69be1ba0210 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:53.672683 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfa1be11-9af7-4c31-9253-b69be1ba0210 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:53.673120 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfa1be11-9af7-4c31-9253-b69be1ba0210 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:53.673890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfa1be11-9af7-4c31-9253-b69be1ba0210 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:53.674320 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfa1be11-9af7-4c31-9253-b69be1ba0210 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:53.822725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-cfa1be11-9af7-4c31-9253-b69be1ba0210 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:53.831570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cfa1be11-9af7-4c31-9253-b69be1ba0210 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1710 microversion: 2.1 time: 0.169996 Jul 14 12:20:53.832531 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 188/370] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:53 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1710 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:54.325123 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-dc52a876-ddaf-4284-8834-4f3899361846 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:54.325722 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-dc52a876-ddaf-4284-8834-4f3899361846 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:54.352399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=62 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:54.355403 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dc52a876-ddaf-4284-8834-4f3899361846 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:54.360112 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dc52a876-ddaf-4284-8834-4f3899361846 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:54.360949 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dc52a876-ddaf-4284-8834-4f3899361846 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:54.361389 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dc52a876-ddaf-4284-8834-4f3899361846 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:54.471312 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-561a53f8-4551-4c02-ad2e-ed30e6183c29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:54.479585 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-561a53f8-4551-4c02-ad2e-ed30e6183c29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:54.491373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-561a53f8-4551-4c02-ad2e-ed30e6183c29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:54.497087 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-561a53f8-4551-4c02-ad2e-ed30e6183c29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:54.499148 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-561a53f8-4551-4c02-ad2e-ed30e6183c29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:54.500844 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-561a53f8-4551-4c02-ad2e-ed30e6183c29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:54.594865 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-dc52a876-ddaf-4284-8834-4f3899361846 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:54.618670 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-dc52a876-ddaf-4284-8834-4f3899361846 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.297782 Jul 14 12:20:54.619683 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 183/371] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:54 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:54.693235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-561a53f8-4551-4c02-ad2e-ed30e6183c29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:54.702521 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-561a53f8-4551-4c02-ad2e-ed30e6183c29 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.234851 Jul 14 12:20:54.703758 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 189/372] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:54 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:20:55.636360 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-092aa13c-52bf-429a-a228-6460a2a3aeed tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:55.636985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-092aa13c-52bf-429a-a228-6460a2a3aeed tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:55.647719 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-092aa13c-52bf-429a-a228-6460a2a3aeed tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:55.659726 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-092aa13c-52bf-429a-a228-6460a2a3aeed tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:55.660524 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-092aa13c-52bf-429a-a228-6460a2a3aeed tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:55.660897 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-092aa13c-52bf-429a-a228-6460a2a3aeed tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:55.731297 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0f4ebb0a-1da5-4f1a-93fb-db042085d17a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:55.731916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0f4ebb0a-1da5-4f1a-93fb-db042085d17a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:55.739456 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0f4ebb0a-1da5-4f1a-93fb-db042085d17a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:55.739919 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0f4ebb0a-1da5-4f1a-93fb-db042085d17a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:55.740714 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0f4ebb0a-1da5-4f1a-93fb-db042085d17a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:55.741150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0f4ebb0a-1da5-4f1a-93fb-db042085d17a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:55.832607 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-092aa13c-52bf-429a-a228-6460a2a3aeed tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:55.841167 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-092aa13c-52bf-429a-a228-6460a2a3aeed tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.209451 Jul 14 12:20:55.842156 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 184/373] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:55 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:56.137954 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0f4ebb0a-1da5-4f1a-93fb-db042085d17a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:56.145407 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0f4ebb0a-1da5-4f1a-93fb-db042085d17a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1502 microversion: 2.1 time: 0.426468 Jul 14 12:20:56.156425 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 190/374] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:55 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1502 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:56.167524 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e4e46442-4669-4017-b1f1-3fea204bd717 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a0914a4-3e02-4037-bfa9-99793366b972"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:56.169279 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e4e46442-4669-4017-b1f1-3fea204bd717 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:56.181024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e4e46442-4669-4017-b1f1-3fea204bd717 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:56.182411 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e4e46442-4669-4017-b1f1-3fea204bd717 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:56.183520 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e4e46442-4669-4017-b1f1-3fea204bd717 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:56.184305 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e4e46442-4669-4017-b1f1-3fea204bd717 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:56.212249 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-e4e46442-4669-4017-b1f1-3fea204bd717 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] HTTP exception thrown: Cannot 'attach_volume' instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe while it is in vm_state rescued Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e4e46442-4669-4017-b1f1-3fea204bd717 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Request method failure captured: Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: POST /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe/os-volume_attachments HTTP/1.1 Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 74 Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmW5SsGlFhf_TzJg-Og2kuIVv8Fr87QiUijllnSUBvnbHpUzpWuE-rphTVE092MKeLDRhLcGVdyeyzuLP58QmtlbDaIh0UNR1NEJmPgt08fjsBh5C6AY25wIZL2k57HAqwpUFzHaNbhMhB6AWiQ5Zhrh_g09fa_3mXp-B0btNHrPWQ Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: bb62d84584b3426687390833270648d6 Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:20:56.215975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb62d84584b3426687390833270648d6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb62d84584b3426687390833270648d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb62d84584b3426687390833270648d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb62d84584b3426687390833270648d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: bb62d84584b3426687390833270648d6 Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-ServerRescueNegativeTestJSON-1890584384-project Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 0d302e57946c42d799e9bf120873eba6 Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1890584384-project Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {"volumeAttachment": {"volumeId": "9a0914a4-3e02-4037-bfa9-99793366b972"}} Jul 14 12:20:56.217375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Cannot 'attach_volume' instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe while it is in vm_state rescued Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'server_id': 'bc2b616c-dc02-4d81-9eb1-028c8077a4fe', 'body': {'volumeAttachment': {'volumeId': '9a0914a4-3e02-4037-bfa9-99793366b972'}}} Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:20:56.218100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe while it is in vm_state rescued Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:20:56.219316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:20:56.221741 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:20:56.221741 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:20:56.221741 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe while it is in vm_state rescued Jul 14 12:20:56.221741 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:20:56.223097 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e4e46442-4669-4017-b1f1-3fea204bd717 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Returning 409 to user: Cannot 'attach_volume' instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe while it is in vm_state rescued {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:20:56.224306 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e4e46442-4669-4017-b1f1-3fea204bd717 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064139 Jul 14 12:20:56.224894 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 185/375] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:20:56 2022] POST /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe/os-volume_attachments => generated 152 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 12:20:56.236612 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-dd9682b7-10f1-4d33-9d43-d084f136a4d8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:20:56.237121 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-dd9682b7-10f1-4d33-9d43-d084f136a4d8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:56.243501 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dd9682b7-10f1-4d33-9d43-d084f136a4d8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:56.243989 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dd9682b7-10f1-4d33-9d43-d084f136a4d8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:56.246243 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dd9682b7-10f1-4d33-9d43-d084f136a4d8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:56.247370 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dd9682b7-10f1-4d33-9d43-d084f136a4d8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:56.262395 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:20:56.497978 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-dd9682b7-10f1-4d33-9d43-d084f136a4d8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe/action" status: 202 len: 0 microversion: 2.1 time: 0.264785 Jul 14 12:20:56.497978 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 191/376] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:20:56 2022] POST /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:20:56.505641 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ff095e4d-97b0-43e0-80f5-d934d55a5bfb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:56.506532 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ff095e4d-97b0-43e0-80f5-d934d55a5bfb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:56.513511 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ff095e4d-97b0-43e0-80f5-d934d55a5bfb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:56.514588 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ff095e4d-97b0-43e0-80f5-d934d55a5bfb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:56.515585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ff095e4d-97b0-43e0-80f5-d934d55a5bfb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:56.516205 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ff095e4d-97b0-43e0-80f5-d934d55a5bfb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:56.805727 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ff095e4d-97b0-43e0-80f5-d934d55a5bfb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:56.820342 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ff095e4d-97b0-43e0-80f5-d934d55a5bfb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1510 microversion: 2.1 time: 0.318417 Jul 14 12:20:56.821656 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 186/377] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:56 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1510 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:56.858757 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-709b3226-b11a-4b77-9d00-bc247f38f620 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:56.859629 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-709b3226-b11a-4b77-9d00-bc247f38f620 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:56.866618 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-709b3226-b11a-4b77-9d00-bc247f38f620 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:56.867099 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-709b3226-b11a-4b77-9d00-bc247f38f620 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:56.867972 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-709b3226-b11a-4b77-9d00-bc247f38f620 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:56.868273 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-709b3226-b11a-4b77-9d00-bc247f38f620 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:57.099422 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-709b3226-b11a-4b77-9d00-bc247f38f620 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:57.111266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-709b3226-b11a-4b77-9d00-bc247f38f620 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.256791 Jul 14 12:20:57.122020 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 192/378] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:56 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:57.841681 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-14eeb3c7-4f9e-42a0-8871-886fa03cf643 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:57.842295 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-14eeb3c7-4f9e-42a0-8871-886fa03cf643 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:57.849408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-14eeb3c7-4f9e-42a0-8871-886fa03cf643 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:57.854134 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-14eeb3c7-4f9e-42a0-8871-886fa03cf643 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:57.854134 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-14eeb3c7-4f9e-42a0-8871-886fa03cf643 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:57.854134 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-14eeb3c7-4f9e-42a0-8871-886fa03cf643 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:58.043828 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-14eeb3c7-4f9e-42a0-8871-886fa03cf643 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:58.058557 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-14eeb3c7-4f9e-42a0-8871-886fa03cf643 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1510 microversion: 2.1 time: 0.221573 Jul 14 12:20:58.059163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 187/379] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:57 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:58.129624 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-647c5641-f861-49b8-ba42-83f8354c2f5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:58.130407 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-647c5641-f861-49b8-ba42-83f8354c2f5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:58.138517 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-647c5641-f861-49b8-ba42-83f8354c2f5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:58.139033 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-647c5641-f861-49b8-ba42-83f8354c2f5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:58.139807 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-647c5641-f861-49b8-ba42-83f8354c2f5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:58.140242 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-647c5641-f861-49b8-ba42-83f8354c2f5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:58.316704 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-647c5641-f861-49b8-ba42-83f8354c2f5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:58.328454 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-647c5641-f861-49b8-ba42-83f8354c2f5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.202826 Jul 14 12:20:58.329805 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 193/380] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:58 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:59.076372 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d0821653-42ae-494b-85b8-3d209724196e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:59.077119 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d0821653-42ae-494b-85b8-3d209724196e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:59.083940 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d0821653-42ae-494b-85b8-3d209724196e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:59.084516 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d0821653-42ae-494b-85b8-3d209724196e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:59.085353 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d0821653-42ae-494b-85b8-3d209724196e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:59.085856 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d0821653-42ae-494b-85b8-3d209724196e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:59.346299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f8b192cb-555a-48ef-9bd1-ef3d6168ff5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:20:59.347136 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f8b192cb-555a-48ef-9bd1-ef3d6168ff5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:20:59.353820 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8b192cb-555a-48ef-9bd1-ef3d6168ff5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:59.356291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8b192cb-555a-48ef-9bd1-ef3d6168ff5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:59.356291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8b192cb-555a-48ef-9bd1-ef3d6168ff5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:20:59.359123 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d0821653-42ae-494b-85b8-3d209724196e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:59.362508 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8b192cb-555a-48ef-9bd1-ef3d6168ff5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:20:59.366678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d0821653-42ae-494b-85b8-3d209724196e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1510 microversion: 2.1 time: 0.294837 Jul 14 12:20:59.367291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 188/381] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:59 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1510 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:20:59.545309 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f8b192cb-555a-48ef-9bd1-ef3d6168ff5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:20:59.556752 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f8b192cb-555a-48ef-9bd1-ef3d6168ff5d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.213622 Jul 14 12:20:59.557966 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 194/382] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:20:59 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:00.387814 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a3c7803c-a3c2-4416-b9b4-2a5a57f4543a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:00.388431 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a3c7803c-a3c2-4416-b9b4-2a5a57f4543a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:00.394820 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a3c7803c-a3c2-4416-b9b4-2a5a57f4543a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:00.395496 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a3c7803c-a3c2-4416-b9b4-2a5a57f4543a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:00.396644 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a3c7803c-a3c2-4416-b9b4-2a5a57f4543a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:00.397389 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a3c7803c-a3c2-4416-b9b4-2a5a57f4543a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:00.573650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-656e1bbf-4e6d-4db0-814f-b8f6c13cf853 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:00.575006 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-656e1bbf-4e6d-4db0-814f-b8f6c13cf853 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:00.577907 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:00.583403 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-656e1bbf-4e6d-4db0-814f-b8f6c13cf853 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:00.583891 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-656e1bbf-4e6d-4db0-814f-b8f6c13cf853 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:00.584679 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-656e1bbf-4e6d-4db0-814f-b8f6c13cf853 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:00.585130 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-656e1bbf-4e6d-4db0-814f-b8f6c13cf853 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:00.628524 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a3c7803c-a3c2-4416-b9b4-2a5a57f4543a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:00.640397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a3c7803c-a3c2-4416-b9b4-2a5a57f4543a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1516 microversion: 2.1 time: 0.258468 Jul 14 12:21:00.654030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 189/383] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:00 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1516 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:00.758071 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-656e1bbf-4e6d-4db0-814f-b8f6c13cf853 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:00.773082 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-656e1bbf-4e6d-4db0-814f-b8f6c13cf853 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.199013 Jul 14 12:21:00.774113 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 195/384] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:00 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:00.938576 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-290026476", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:01.009199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] validate_networks() for None {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:21:01.317148 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:21:01.317567 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:21:01.318277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:21:01.319996 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:21:01.320561 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:21:01.336197 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:01.336647 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:01.338243 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:01.338738 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:01.361538 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Getting quotas for project 206723edeb144547882daa902124ed7c. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:21:01.365844 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Getting quotas for user ca8ddc2748da4b05bc6d7ee16ee3db24 and project 206723edeb144547882daa902124ed7c. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:21:01.377907 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:21:01.380443 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:21:01.459564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e865e59d-e0f5-4b36-8561-74773e76773a tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525082 Jul 14 12:21:01.460374 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 190/385] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:21:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:21:01.470986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b83639a2-9b57-4d69-8733-82a3a923e8fe tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:01.471602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b83639a2-9b57-4d69-8733-82a3a923e8fe tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:01.530898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b83639a2-9b57-4d69-8733-82a3a923e8fe tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:01.541021 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b83639a2-9b57-4d69-8733-82a3a923e8fe tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1214 microversion: 2.1 time: 0.073334 Jul 14 12:21:01.541627 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 196/386] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:01 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:01.794825 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e9857064-b791-401f-ba77-32273edd5139 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:01.795457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e9857064-b791-401f-ba77-32273edd5139 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:01.802228 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e9857064-b791-401f-ba77-32273edd5139 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:01.802679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e9857064-b791-401f-ba77-32273edd5139 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:01.803893 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e9857064-b791-401f-ba77-32273edd5139 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:01.804330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e9857064-b791-401f-ba77-32273edd5139 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:01.969696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e9857064-b791-401f-ba77-32273edd5139 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:01.979697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e9857064-b791-401f-ba77-32273edd5139 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.191236 Jul 14 12:21:01.980409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 191/387] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:01 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:02.558154 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fea55c02-9b12-4987-a5c1-d50707b53358 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:02.560157 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fea55c02-9b12-4987-a5c1-d50707b53358 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:02.571473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fea55c02-9b12-4987-a5c1-d50707b53358 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:02.572998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fea55c02-9b12-4987-a5c1-d50707b53358 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:02.574067 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fea55c02-9b12-4987-a5c1-d50707b53358 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:02.574946 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fea55c02-9b12-4987-a5c1-d50707b53358 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:02.642821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-fea55c02-9b12-4987-a5c1-d50707b53358 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:02.656885 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fea55c02-9b12-4987-a5c1-d50707b53358 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1218 microversion: 2.1 time: 0.099913 Jul 14 12:21:02.663051 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 197/388] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:02 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:02.996729 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3408273c-4b2e-4566-9043-add8414394cf tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:02.998205 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3408273c-4b2e-4566-9043-add8414394cf tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:03.010047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3408273c-4b2e-4566-9043-add8414394cf tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:03.010507 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3408273c-4b2e-4566-9043-add8414394cf tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:03.011321 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3408273c-4b2e-4566-9043-add8414394cf tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:03.012605 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3408273c-4b2e-4566-9043-add8414394cf tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:03.225456 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3408273c-4b2e-4566-9043-add8414394cf tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:03.245193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3408273c-4b2e-4566-9043-add8414394cf tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.252200 Jul 14 12:21:03.254825 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 192/389] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:02 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:03.669836 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-26b00a53-d96e-4610-8c39-45bb89da884c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:03.671143 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-26b00a53-d96e-4610-8c39-45bb89da884c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:03.678001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-26b00a53-d96e-4610-8c39-45bb89da884c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:03.678704 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-26b00a53-d96e-4610-8c39-45bb89da884c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:03.679684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-26b00a53-d96e-4610-8c39-45bb89da884c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:03.680283 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-26b00a53-d96e-4610-8c39-45bb89da884c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:03.751595 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-26b00a53-d96e-4610-8c39-45bb89da884c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:03.763129 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-26b00a53-d96e-4610-8c39-45bb89da884c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1218 microversion: 2.1 time: 0.097433 Jul 14 12:21:03.764568 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 198/390] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:03 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1218 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:04.264013 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3de1514c-3c19-4428-b850-35e195123256 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:04.265384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3de1514c-3c19-4428-b850-35e195123256 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:04.283080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3de1514c-3c19-4428-b850-35e195123256 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:04.285304 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3de1514c-3c19-4428-b850-35e195123256 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:04.286101 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3de1514c-3c19-4428-b850-35e195123256 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:04.286541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3de1514c-3c19-4428-b850-35e195123256 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:04.497954 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3de1514c-3c19-4428-b850-35e195123256 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:04.507561 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3de1514c-3c19-4428-b850-35e195123256 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.249725 Jul 14 12:21:04.517857 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 193/391] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:04 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:04.781542 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c2bacfc9-c826-4801-8ffb-fe907448bf23 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:04.782195 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c2bacfc9-c826-4801-8ffb-fe907448bf23 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:04.800235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2bacfc9-c826-4801-8ffb-fe907448bf23 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:04.800235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2bacfc9-c826-4801-8ffb-fe907448bf23 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:04.800235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2bacfc9-c826-4801-8ffb-fe907448bf23 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:04.800235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2bacfc9-c826-4801-8ffb-fe907448bf23 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:04.864565 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c2bacfc9-c826-4801-8ffb-fe907448bf23 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:04.873793 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c2bacfc9-c826-4801-8ffb-fe907448bf23 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1210 microversion: 2.1 time: 0.096549 Jul 14 12:21:04.874538 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 199/392] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:04 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:05.524679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-58e82cf7-5bf1-47da-9cff-32ed7af4989a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:05.526087 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-58e82cf7-5bf1-47da-9cff-32ed7af4989a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:05.537921 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3bfd593d-b01d-4144-b0ee-17465223070b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'create', calling method: .version_select at 0x7f0e28e92ca0>, body: {"keypair": {"name": "tempest-keypair-1646546956", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9ajSzYRszzpRSGslYZK/qQL/o5Fz1DCmVfr21zBInabNhCDQVEVnf6DpIFbc2fpyQAvQG/AAhy2yp0lNNvCnxpWt29aYgaPwbbT55ZATtVeExwSOu+7kTObjqcW9tJcg=="}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:05.550021 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-58e82cf7-5bf1-47da-9cff-32ed7af4989a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:05.550467 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-58e82cf7-5bf1-47da-9cff-32ed7af4989a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:05.551285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-58e82cf7-5bf1-47da-9cff-32ed7af4989a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:05.555173 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-58e82cf7-5bf1-47da-9cff-32ed7af4989a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:05.568816 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-3bfd593d-b01d-4144-b0ee-17465223070b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Getting quotas for project bb62d84584b3426687390833270648d6. Resources: {'key_pairs'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:21:05.574316 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-3bfd593d-b01d-4144-b0ee-17465223070b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Getting quotas for user 0d302e57946c42d799e9bf120873eba6 and project bb62d84584b3426687390833270648d6. Resources: {'key_pairs'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:21:05.693447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3bfd593d-b01d-4144-b0ee-17465223070b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.159457 Jul 14 12:21:05.694445 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 200/393] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 12:21:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:21:05.725090 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-58e82cf7-5bf1-47da-9cff-32ed7af4989a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:05.736172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-58e82cf7-5bf1-47da-9cff-32ed7af4989a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.213530 Jul 14 12:21:05.736172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 194/394] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:05 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:05.892104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-71b7b682-3d82-49ee-bee9-58af08e5ba07 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:05.913051 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-71b7b682-3d82-49ee-bee9-58af08e5ba07 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:05.939358 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-71b7b682-3d82-49ee-bee9-58af08e5ba07 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:05.945664 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-71b7b682-3d82-49ee-bee9-58af08e5ba07 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:05.947766 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-71b7b682-3d82-49ee-bee9-58af08e5ba07 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:05.949126 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-71b7b682-3d82-49ee-bee9-58af08e5ba07 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:06.109219 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-71b7b682-3d82-49ee-bee9-58af08e5ba07 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:06.126968 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-71b7b682-3d82-49ee-bee9-58af08e5ba07 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1274 microversion: 2.1 time: 0.236081 Jul 14 12:21:06.137614 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 201/395] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:05 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1274 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:06.751162 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d17f6859-4262-4f2e-afae-7b284c086158 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:06.752627 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d17f6859-4262-4f2e-afae-7b284c086158 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:06.763690 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d17f6859-4262-4f2e-afae-7b284c086158 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:06.766753 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d17f6859-4262-4f2e-afae-7b284c086158 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:06.768008 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d17f6859-4262-4f2e-afae-7b284c086158 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:06.768448 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d17f6859-4262-4f2e-afae-7b284c086158 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:06.990401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d17f6859-4262-4f2e-afae-7b284c086158 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:07.014930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d17f6859-4262-4f2e-afae-7b284c086158 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.267501 Jul 14 12:21:07.027261 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 195/396] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:06 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:07.145499 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-508bef63-739c-490e-9bc7-118c743190f1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:07.146099 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-508bef63-739c-490e-9bc7-118c743190f1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:07.155828 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-508bef63-739c-490e-9bc7-118c743190f1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:07.156543 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-508bef63-739c-490e-9bc7-118c743190f1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:07.157500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-508bef63-739c-490e-9bc7-118c743190f1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:07.158138 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-508bef63-739c-490e-9bc7-118c743190f1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:07.247371 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-508bef63-739c-490e-9bc7-118c743190f1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:07.258298 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-508bef63-739c-490e-9bc7-118c743190f1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1272 microversion: 2.1 time: 0.117142 Jul 14 12:21:07.271890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 202/397] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:07 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1272 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:08.034259 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-592f0824-aa72-4be8-a20c-4ddc90119411 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:08.034930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-592f0824-aa72-4be8-a20c-4ddc90119411 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:08.044424 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-592f0824-aa72-4be8-a20c-4ddc90119411 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:08.045112 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-592f0824-aa72-4be8-a20c-4ddc90119411 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:08.046087 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-592f0824-aa72-4be8-a20c-4ddc90119411 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:08.046992 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-592f0824-aa72-4be8-a20c-4ddc90119411 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:08.283816 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a2b29b95-5efb-4e18-b715-4ee0531461b0 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:08.287329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a2b29b95-5efb-4e18-b715-4ee0531461b0 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:08.308204 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-592f0824-aa72-4be8-a20c-4ddc90119411 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:08.319967 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-592f0824-aa72-4be8-a20c-4ddc90119411 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.290923 Jul 14 12:21:08.327886 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a2b29b95-5efb-4e18-b715-4ee0531461b0 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:08.329149 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 196/398] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:08 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:08.344151 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a2b29b95-5efb-4e18-b715-4ee0531461b0 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:08.345284 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a2b29b95-5efb-4e18-b715-4ee0531461b0 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:08.345892 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a2b29b95-5efb-4e18-b715-4ee0531461b0 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:08.569465 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a2b29b95-5efb-4e18-b715-4ee0531461b0 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:08.578986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a2b29b95-5efb-4e18-b715-4ee0531461b0 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.303302 Jul 14 12:21:08.594408 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 203/399] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:08 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:08.793354 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-89822788-e0eb-4dfa-b5d2-e6c6d66e941b req-2575d2a3-a983-487e-8af9-4aa0eebcc7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aca3a55-17cb-461a-ad99-5606410ac540", "tag": "5a931f59-eb56-4d86-86ee-de446155344c"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:08.823193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-89822788-e0eb-4dfa-b5d2-e6c6d66e941b req-2575d2a3-a983-487e-8af9-4aa0eebcc7d4 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:08.823647 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-89822788-e0eb-4dfa-b5d2-e6c6d66e941b req-2575d2a3-a983-487e-8af9-4aa0eebcc7d4 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:08.847153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-89822788-e0eb-4dfa-b5d2-e6c6d66e941b req-2575d2a3-a983-487e-8af9-4aa0eebcc7d4 service nova] Creating event network-changed:5a931f59-eb56-4d86-86ee-de446155344c for instance 2aca3a55-17cb-461a-ad99-5606410ac540 on hv-cinder-84890 Jul 14 12:21:08.856732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-89822788-e0eb-4dfa-b5d2-e6c6d66e941b req-2575d2a3-a983-487e-8af9-4aa0eebcc7d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071028 Jul 14 12:21:08.857659 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 197/400] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:08.941227 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-259658903", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d58f87ee-c5c6-4211-9aab-58c9b00ee645"}], "security_groups": [{"name": "tempest-securitygroup--943050481"}], "key_name": "tempest-keypair-1646546956", "user_data": "}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:09.120400 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.network.neutron [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] validate_networks() for [('d58f87ee-c5c6-4211-9aab-58c9b00ee645', None, None, None, None, None)] {{(pid=118262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:21:09.326351 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-f42b9fe5-9be7-4383-a36d-61f7cef93151 req-7303ac74-9265-44b9-9668-932376a68b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905d8954-a633-4e05-a5eb-1bd833799fea", "name": "network-vif-plugged", "status": "completed", "tag": "97573f11-1cde-45f1-8103-8f5b45ac6f97"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:09.351304 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-f42b9fe5-9be7-4383-a36d-61f7cef93151 req-7303ac74-9265-44b9-9668-932376a68b96 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:09.352056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-f42b9fe5-9be7-4383-a36d-61f7cef93151 req-7303ac74-9265-44b9-9668-932376a68b96 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:09.369399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-f42b9fe5-9be7-4383-a36d-61f7cef93151 req-7303ac74-9265-44b9-9668-932376a68b96 service nova] Creating event network-vif-plugged:97573f11-1cde-45f1-8103-8f5b45ac6f97 for instance 905d8954-a633-4e05-a5eb-1bd833799fea on hv-cinder-84890 Jul 14 12:21:09.391453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-f42b9fe5-9be7-4383-a36d-61f7cef93151 req-7303ac74-9265-44b9-9668-932376a68b96 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074445 Jul 14 12:21:09.391453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 198/401] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:09.396911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f171fcd0-aac6-4d99-882b-0f8589425684 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:09.397806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f171fcd0-aac6-4d99-882b-0f8589425684 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:09.433047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f171fcd0-aac6-4d99-882b-0f8589425684 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:09.434179 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f171fcd0-aac6-4d99-882b-0f8589425684 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:09.436569 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f171fcd0-aac6-4d99-882b-0f8589425684 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:09.437178 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f171fcd0-aac6-4d99-882b-0f8589425684 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:09.798202 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f171fcd0-aac6-4d99-882b-0f8589425684 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:09.798202 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f171fcd0-aac6-4d99-882b-0f8589425684 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.305644 Jul 14 12:21:09.798202 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 199/402] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:09 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:09.798202 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5bd4538e-fc37-46bb-9e5b-637afdd37866 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:09.798546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5bd4538e-fc37-46bb-9e5b-637afdd37866 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:09.798546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5bd4538e-fc37-46bb-9e5b-637afdd37866 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:09.798546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5bd4538e-fc37-46bb-9e5b-637afdd37866 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:09.798546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5bd4538e-fc37-46bb-9e5b-637afdd37866 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:09.798864 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5bd4538e-fc37-46bb-9e5b-637afdd37866 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:09.953471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5bd4538e-fc37-46bb-9e5b-637afdd37866 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:09.953471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:09.953471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5bd4538e-fc37-46bb-9e5b-637afdd37866 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.245798 Jul 14 12:21:09.953471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 200/403] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:09 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:09.996514 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Flavor limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:21:09.997032 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Image limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:21:09.997487 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Flavor pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:21:09.997953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Image pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:21:09.998422 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:21:10.007817 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:10.008271 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:10.009291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:10.009928 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:10.029002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Getting quotas for project bb62d84584b3426687390833270648d6. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:21:10.033733 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Getting quotas for user 0d302e57946c42d799e9bf120873eba6 and project bb62d84584b3426687390833270648d6. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:21:10.045875 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Going to run 1 instances... {{(pid=118262) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:21:10.048488 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:21:10.402073 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-682e3618-ee3b-495e-8d02-b0dbd440dc42 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.465243 Jul 14 12:21:10.404526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 204/404] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:21:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:21:10.413134 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-00d7d251-8817-46a6-8506-80c77e50d6b6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:10.413733 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-00d7d251-8817-46a6-8506-80c77e50d6b6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:10.476061 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-00d7d251-8817-46a6-8506-80c77e50d6b6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:10.484151 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-00d7d251-8817-46a6-8506-80c77e50d6b6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1245 microversion: 2.1 time: 0.075172 Jul 14 12:21:10.488932 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 201/405] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:10 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:10.717096 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-93078b62-7252-4811-80b3-81f67984abe8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:10.717712 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-93078b62-7252-4811-80b3-81f67984abe8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:10.727223 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-93078b62-7252-4811-80b3-81f67984abe8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:10.729961 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-93078b62-7252-4811-80b3-81f67984abe8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:10.731652 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-93078b62-7252-4811-80b3-81f67984abe8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:10.740138 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-93078b62-7252-4811-80b3-81f67984abe8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:10.907024 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-93078b62-7252-4811-80b3-81f67984abe8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:10.920129 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-93078b62-7252-4811-80b3-81f67984abe8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.201841 Jul 14 12:21:10.920129 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 205/406] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:10 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:10.969579 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8c398bb5-0b99-44c8-b002-e00ccde8b66d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:10.970453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8c398bb5-0b99-44c8-b002-e00ccde8b66d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:10.976760 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c398bb5-0b99-44c8-b002-e00ccde8b66d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:10.977567 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c398bb5-0b99-44c8-b002-e00ccde8b66d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:10.979432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c398bb5-0b99-44c8-b002-e00ccde8b66d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:10.980042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c398bb5-0b99-44c8-b002-e00ccde8b66d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:11.166106 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8c398bb5-0b99-44c8-b002-e00ccde8b66d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:11.175358 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8c398bb5-0b99-44c8-b002-e00ccde8b66d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.209945 Jul 14 12:21:11.185630 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 202/407] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:10 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:11.505382 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d1201ed3-a7c8-49b5-b328-4b0118b51c48 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:11.506904 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d1201ed3-a7c8-49b5-b328-4b0118b51c48 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:11.514306 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d1201ed3-a7c8-49b5-b328-4b0118b51c48 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:11.515081 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d1201ed3-a7c8-49b5-b328-4b0118b51c48 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:11.516371 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d1201ed3-a7c8-49b5-b328-4b0118b51c48 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:11.516982 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d1201ed3-a7c8-49b5-b328-4b0118b51c48 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:11.585224 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d1201ed3-a7c8-49b5-b328-4b0118b51c48 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:11.596642 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d1201ed3-a7c8-49b5-b328-4b0118b51c48 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1249 microversion: 2.1 time: 0.094923 Jul 14 12:21:11.597661 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 206/408] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:11 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:11.934879 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-da9a868e-b205-402f-bcb5-c85e3c07edb6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:11.936019 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-da9a868e-b205-402f-bcb5-c85e3c07edb6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:11.938818 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:11.944533 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da9a868e-b205-402f-bcb5-c85e3c07edb6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:11.945199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da9a868e-b205-402f-bcb5-c85e3c07edb6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:11.946005 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da9a868e-b205-402f-bcb5-c85e3c07edb6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:11.947254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da9a868e-b205-402f-bcb5-c85e3c07edb6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:12.097465 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-da9a868e-b205-402f-bcb5-c85e3c07edb6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:12.105944 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-da9a868e-b205-402f-bcb5-c85e3c07edb6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.175688 Jul 14 12:21:12.106513 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 203/409] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:11 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:12.195015 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-feccef52-ebdb-4de2-b419-6cf114f1b2da tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:12.195753 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-feccef52-ebdb-4de2-b419-6cf114f1b2da tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:12.202659 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-feccef52-ebdb-4de2-b419-6cf114f1b2da tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:12.203149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-feccef52-ebdb-4de2-b419-6cf114f1b2da tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:12.203951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-feccef52-ebdb-4de2-b419-6cf114f1b2da tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:12.204388 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-feccef52-ebdb-4de2-b419-6cf114f1b2da tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:12.347904 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-feccef52-ebdb-4de2-b419-6cf114f1b2da tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:12.356534 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-feccef52-ebdb-4de2-b419-6cf114f1b2da tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.165257 Jul 14 12:21:12.357348 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 207/410] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:12 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:12.614462 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c2580140-809f-4ad8-a919-4f4500dba269 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:12.615149 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c2580140-809f-4ad8-a919-4f4500dba269 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:12.621872 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c2580140-809f-4ad8-a919-4f4500dba269 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:12.623231 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c2580140-809f-4ad8-a919-4f4500dba269 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:12.623231 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c2580140-809f-4ad8-a919-4f4500dba269 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:12.623561 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c2580140-809f-4ad8-a919-4f4500dba269 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:12.691731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c2580140-809f-4ad8-a919-4f4500dba269 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:12.699701 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c2580140-809f-4ad8-a919-4f4500dba269 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1249 microversion: 2.1 time: 0.088945 Jul 14 12:21:12.700457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 204/411] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:12 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1249 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:13.123370 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-05f73124-2a23-486d-bc95-3782dd0f534f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:13.124170 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-05f73124-2a23-486d-bc95-3782dd0f534f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:13.131075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-05f73124-2a23-486d-bc95-3782dd0f534f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:13.131652 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-05f73124-2a23-486d-bc95-3782dd0f534f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:13.132289 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-05f73124-2a23-486d-bc95-3782dd0f534f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:13.132741 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-05f73124-2a23-486d-bc95-3782dd0f534f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:13.279133 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-05f73124-2a23-486d-bc95-3782dd0f534f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:13.286638 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-05f73124-2a23-486d-bc95-3782dd0f534f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.167628 Jul 14 12:21:13.287235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 208/412] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:13 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:13.374712 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-03c8577b-548b-4e1d-9892-d0bbd9ce3134 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:13.375504 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-03c8577b-548b-4e1d-9892-d0bbd9ce3134 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:13.382646 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03c8577b-548b-4e1d-9892-d0bbd9ce3134 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:13.383190 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03c8577b-548b-4e1d-9892-d0bbd9ce3134 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:13.384472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03c8577b-548b-4e1d-9892-d0bbd9ce3134 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:13.384962 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03c8577b-548b-4e1d-9892-d0bbd9ce3134 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:13.522840 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-03c8577b-548b-4e1d-9892-d0bbd9ce3134 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:13.530555 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-03c8577b-548b-4e1d-9892-d0bbd9ce3134 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.160137 Jul 14 12:21:13.531142 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 205/413] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:13 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:13.716891 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-dea486b0-e744-488d-8faa-249634f4310b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:13.717502 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-dea486b0-e744-488d-8faa-249634f4310b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:13.723661 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dea486b0-e744-488d-8faa-249634f4310b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:13.724129 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dea486b0-e744-488d-8faa-249634f4310b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:13.724880 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dea486b0-e744-488d-8faa-249634f4310b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:13.725314 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dea486b0-e744-488d-8faa-249634f4310b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:13.744113 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:13.791858 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dea486b0-e744-488d-8faa-249634f4310b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:13.799313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-dea486b0-e744-488d-8faa-249634f4310b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1249 microversion: 2.1 time: 0.086232 Jul 14 12:21:13.799877 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 209/414] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:13 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:14.303704 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3c86f36e-5778-40d1-a5b9-c0bd8ceef687 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:14.304321 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3c86f36e-5778-40d1-a5b9-c0bd8ceef687 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:14.311335 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3c86f36e-5778-40d1-a5b9-c0bd8ceef687 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:14.311772 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3c86f36e-5778-40d1-a5b9-c0bd8ceef687 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:14.312537 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3c86f36e-5778-40d1-a5b9-c0bd8ceef687 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:14.312964 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3c86f36e-5778-40d1-a5b9-c0bd8ceef687 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:14.455383 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3c86f36e-5778-40d1-a5b9-c0bd8ceef687 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:14.463217 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3c86f36e-5778-40d1-a5b9-c0bd8ceef687 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.163574 Jul 14 12:21:14.463784 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 206/415] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:14 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:14.548074 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d225dbdd-fa39-4ead-9a2a-a325812f1798 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:14.548675 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d225dbdd-fa39-4ead-9a2a-a325812f1798 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:14.556477 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d225dbdd-fa39-4ead-9a2a-a325812f1798 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:14.557173 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d225dbdd-fa39-4ead-9a2a-a325812f1798 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:14.557960 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d225dbdd-fa39-4ead-9a2a-a325812f1798 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:14.558391 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d225dbdd-fa39-4ead-9a2a-a325812f1798 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:14.696654 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d225dbdd-fa39-4ead-9a2a-a325812f1798 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:14.706958 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d225dbdd-fa39-4ead-9a2a-a325812f1798 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.162759 Jul 14 12:21:14.707797 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 210/416] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:14 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:14.816833 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-1521a71f-11e3-45c3-ae5a-61bfeb8ac0a6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:14.817794 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-1521a71f-11e3-45c3-ae5a-61bfeb8ac0a6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:14.824498 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1521a71f-11e3-45c3-ae5a-61bfeb8ac0a6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:14.824947 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1521a71f-11e3-45c3-ae5a-61bfeb8ac0a6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:14.825714 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1521a71f-11e3-45c3-ae5a-61bfeb8ac0a6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:14.826152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1521a71f-11e3-45c3-ae5a-61bfeb8ac0a6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:14.834493 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-31074c88-ab61-4506-a99b-fde5217ce629 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Action: 'create', calling method: .version_select at 0x7f0e26745700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-497702175", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL0kcl+32U4GBG5uX79X0GotBjS44IjAB/0lrnH2QYyV4aXNxTBbSS1cgDdm33TWyLZAvURnuI8fDAVh96WKloCfvkyDfdkufUN+seWcPQgZu65lsUGI/6KuWKZ+yp2Zqw=="}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:14.849025 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-31074c88-ab61-4506-a99b-fde5217ce629 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Getting quotas for project a37bbdf2bd2f4392ab2ddb60d6b6ad7c. Resources: {'key_pairs'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:21:14.853978 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-31074c88-ab61-4506-a99b-fde5217ce629 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Getting quotas for user c72a81dcca3145fe9f9623e49baba829 and project a37bbdf2bd2f4392ab2ddb60d6b6ad7c. Resources: {'key_pairs'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:21:14.887659 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1521a71f-11e3-45c3-ae5a-61bfeb8ac0a6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:14.895139 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-1521a71f-11e3-45c3-ae5a-61bfeb8ac0a6 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1241 microversion: 2.1 time: 0.082260 Jul 14 12:21:14.895695 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 207/417] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:14 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1241 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:14.933779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-31074c88-ab61-4506-a99b-fde5217ce629 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.103147 Jul 14 12:21:14.934408 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 211/418] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 12:21:14 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:21:14.981863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1729136748", "imageRef": "68f26347-60c6-4a69-89c6-d3b2eb4d295a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-497702175", "networks": [{"uuid": "c8c2692e-4527-41ed-9aa4-f0917dfa8533"}]}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:15.038467 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] validate_networks() for [('c8c2692e-4527-41ed-9aa4-f0917dfa8533', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:21:15.409754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:21:15.410229 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:21:15.410681 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:21:15.411119 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:21:15.411534 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:21:15.422028 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:15.422482 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:15.423313 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:15.423747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:15.440813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Getting quotas for project a37bbdf2bd2f4392ab2ddb60d6b6ad7c. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:21:15.444874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Getting quotas for user c72a81dcca3145fe9f9623e49baba829 and project a37bbdf2bd2f4392ab2ddb60d6b6ad7c. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:21:15.455917 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:21:15.458105 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='68f26347-60c6-4a69-89c6-d3b2eb4d295a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:21:15.481269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-42551ee0-9a47-4f95-8ae6-6b44b27ba2e8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:15.481804 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-42551ee0-9a47-4f95-8ae6-6b44b27ba2e8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:15.488281 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-42551ee0-9a47-4f95-8ae6-6b44b27ba2e8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:15.488738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-42551ee0-9a47-4f95-8ae6-6b44b27ba2e8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:15.489627 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-42551ee0-9a47-4f95-8ae6-6b44b27ba2e8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:15.490062 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-42551ee0-9a47-4f95-8ae6-6b44b27ba2e8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:15.595627 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d901ccdc-fb89-49d9-8143-794facc6d62f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618261 Jul 14 12:21:15.596350 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 208/419] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:21:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:21:15.606699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-898b45ec-13c4-4b82-9783-4679fe97702d tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:15.607662 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-898b45ec-13c4-4b82-9783-4679fe97702d tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:15.638544 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-42551ee0-9a47-4f95-8ae6-6b44b27ba2e8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:15.648407 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-42551ee0-9a47-4f95-8ae6-6b44b27ba2e8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1257 microversion: 2.1 time: 0.172141 Jul 14 12:21:15.649192 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 212/420] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:15 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1257 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:15.664422 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-898b45ec-13c4-4b82-9783-4679fe97702d tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:15.672955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-898b45ec-13c4-4b82-9783-4679fe97702d tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1258 microversion: 2.1 time: 0.070625 Jul 14 12:21:15.673636 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 209/421] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:15 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:15.724525 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-77dfa49c-3062-4bd3-9060-df5b574a33af tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:15.725623 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-77dfa49c-3062-4bd3-9060-df5b574a33af tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:15.734111 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-77dfa49c-3062-4bd3-9060-df5b574a33af tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:15.734516 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-77dfa49c-3062-4bd3-9060-df5b574a33af tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:15.735518 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-77dfa49c-3062-4bd3-9060-df5b574a33af tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:15.735952 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-77dfa49c-3062-4bd3-9060-df5b574a33af tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:15.882744 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-77dfa49c-3062-4bd3-9060-df5b574a33af tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:15.891286 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-77dfa49c-3062-4bd3-9060-df5b574a33af tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.170256 Jul 14 12:21:15.892372 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 213/422] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:15 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:15.912358 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f96e265b-7e1d-4457-89ba-e8ba8bf6c42a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:15.912966 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f96e265b-7e1d-4457-89ba-e8ba8bf6c42a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:15.919822 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f96e265b-7e1d-4457-89ba-e8ba8bf6c42a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:15.920269 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f96e265b-7e1d-4457-89ba-e8ba8bf6c42a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:15.921026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f96e265b-7e1d-4457-89ba-e8ba8bf6c42a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:15.921458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f96e265b-7e1d-4457-89ba-e8ba8bf6c42a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:15.982889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f96e265b-7e1d-4457-89ba-e8ba8bf6c42a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:15.990366 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f96e265b-7e1d-4457-89ba-e8ba8bf6c42a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1297 microversion: 2.1 time: 0.081803 Jul 14 12:21:15.990879 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 210/423] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:15 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:16.665935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2d303103-b6f7-4732-b05e-85df4453a1de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:16.666539 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2d303103-b6f7-4732-b05e-85df4453a1de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:16.673641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2d303103-b6f7-4732-b05e-85df4453a1de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:16.674110 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2d303103-b6f7-4732-b05e-85df4453a1de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:16.674893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2d303103-b6f7-4732-b05e-85df4453a1de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:16.675334 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2d303103-b6f7-4732-b05e-85df4453a1de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:16.691186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8c9d7779-3d71-417f-969b-258291958f29 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:16.692387 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8c9d7779-3d71-417f-969b-258291958f29 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:16.699231 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c9d7779-3d71-417f-969b-258291958f29 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:16.699681 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c9d7779-3d71-417f-969b-258291958f29 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:16.701848 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c9d7779-3d71-417f-969b-258291958f29 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:16.701848 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c9d7779-3d71-417f-969b-258291958f29 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:16.764535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8c9d7779-3d71-417f-969b-258291958f29 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:16.772348 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8c9d7779-3d71-417f-969b-258291958f29 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1262 microversion: 2.1 time: 0.085539 Jul 14 12:21:16.772858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 211/424] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:16 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1262 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:16.819475 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2d303103-b6f7-4732-b05e-85df4453a1de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:16.827765 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2d303103-b6f7-4732-b05e-85df4453a1de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1441 microversion: 2.1 time: 0.166017 Jul 14 12:21:16.828339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 214/425] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:16 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1441 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:16.845414 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-84072ea7-879c-46d8-b550-6de089a515de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:16.846022 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-84072ea7-879c-46d8-b550-6de089a515de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:16.851909 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84072ea7-879c-46d8-b550-6de089a515de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:16.856449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84072ea7-879c-46d8-b550-6de089a515de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:16.856449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84072ea7-879c-46d8-b550-6de089a515de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:16.856449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84072ea7-879c-46d8-b550-6de089a515de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:16.909511 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-79ce69f6-22bf-445d-b4b9-790e68de851b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:16.910433 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-79ce69f6-22bf-445d-b4b9-790e68de851b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:16.917155 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-79ce69f6-22bf-445d-b4b9-790e68de851b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:16.917602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-79ce69f6-22bf-445d-b4b9-790e68de851b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:16.918384 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-79ce69f6-22bf-445d-b4b9-790e68de851b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:16.919362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-79ce69f6-22bf-445d-b4b9-790e68de851b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:17.060976 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-79ce69f6-22bf-445d-b4b9-790e68de851b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:17.069043 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-79ce69f6-22bf-445d-b4b9-790e68de851b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.163332 Jul 14 12:21:17.069860 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 215/426] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:16 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:17.075519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2feef3a3-0d82-4243-aafc-2af0efc6ede8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:17.076332 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2feef3a3-0d82-4243-aafc-2af0efc6ede8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:17.084534 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2feef3a3-0d82-4243-aafc-2af0efc6ede8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:17.084997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2feef3a3-0d82-4243-aafc-2af0efc6ede8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:17.085866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2feef3a3-0d82-4243-aafc-2af0efc6ede8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:17.086314 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2feef3a3-0d82-4243-aafc-2af0efc6ede8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:17.155614 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2feef3a3-0d82-4243-aafc-2af0efc6ede8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:17.165656 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2feef3a3-0d82-4243-aafc-2af0efc6ede8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1303 microversion: 2.1 time: 0.094555 Jul 14 12:21:17.166441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 216/427] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:17 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:17.331402 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-84072ea7-879c-46d8-b550-6de089a515de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:17.342492 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-84072ea7-879c-46d8-b550-6de089a515de tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1441 microversion: 2.1 time: 0.500777 Jul 14 12:21:17.343117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 212/428] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:16 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1441 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:17.791680 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-94c39bcd-1e72-4a12-8858-fd9e7cf07c78 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:17.793086 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-94c39bcd-1e72-4a12-8858-fd9e7cf07c78 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:17.803063 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-94c39bcd-1e72-4a12-8858-fd9e7cf07c78 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:17.803529 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-94c39bcd-1e72-4a12-8858-fd9e7cf07c78 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:17.804447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-94c39bcd-1e72-4a12-8858-fd9e7cf07c78 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:17.805174 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-94c39bcd-1e72-4a12-8858-fd9e7cf07c78 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:17.875574 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-94c39bcd-1e72-4a12-8858-fd9e7cf07c78 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:17.885582 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-94c39bcd-1e72-4a12-8858-fd9e7cf07c78 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1310 microversion: 2.1 time: 0.099784 Jul 14 12:21:17.886268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 217/429] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:17 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1310 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:18.088191 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-309545ec-3e98-4323-8370-3e2caff1c3b4 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:18.088761 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-309545ec-3e98-4323-8370-3e2caff1c3b4 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:18.095763 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-309545ec-3e98-4323-8370-3e2caff1c3b4 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:18.096310 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-309545ec-3e98-4323-8370-3e2caff1c3b4 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:18.097153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-309545ec-3e98-4323-8370-3e2caff1c3b4 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:18.097662 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-309545ec-3e98-4323-8370-3e2caff1c3b4 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:18.183244 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-eec9aed4-2dd4-4bd9-b80e-bdb7cee37610 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:18.183964 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-eec9aed4-2dd4-4bd9-b80e-bdb7cee37610 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:18.190541 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eec9aed4-2dd4-4bd9-b80e-bdb7cee37610 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:18.191112 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eec9aed4-2dd4-4bd9-b80e-bdb7cee37610 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:18.191943 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eec9aed4-2dd4-4bd9-b80e-bdb7cee37610 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:18.192386 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eec9aed4-2dd4-4bd9-b80e-bdb7cee37610 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:18.332111 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-eec9aed4-2dd4-4bd9-b80e-bdb7cee37610 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:18.341239 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-eec9aed4-2dd4-4bd9-b80e-bdb7cee37610 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.161926 Jul 14 12:21:18.341818 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 218/430] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:18 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:18.482119 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-309545ec-3e98-4323-8370-3e2caff1c3b4 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:18.489452 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-309545ec-3e98-4323-8370-3e2caff1c3b4 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.405716 Jul 14 12:21:18.500684 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 213/431] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:18 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:18.903544 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-32c50ad1-a6db-4976-b306-c25a05200e2b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:18.904161 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-32c50ad1-a6db-4976-b306-c25a05200e2b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:18.910619 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-32c50ad1-a6db-4976-b306-c25a05200e2b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:18.911113 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-32c50ad1-a6db-4976-b306-c25a05200e2b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:18.911898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-32c50ad1-a6db-4976-b306-c25a05200e2b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:18.912329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-32c50ad1-a6db-4976-b306-c25a05200e2b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:18.977222 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-32c50ad1-a6db-4976-b306-c25a05200e2b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:18.986500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-32c50ad1-a6db-4976-b306-c25a05200e2b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1316 microversion: 2.1 time: 0.087370 Jul 14 12:21:18.987146 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 219/432] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:18 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1316 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:19.224365 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-e9fb043f-b64e-4349-a388-8d7de4d9165c req-29f261ba-0d29-4e98-ab5b-452ae68b360f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aca3a55-17cb-461a-ad99-5606410ac540", "name": "network-vif-plugged", "status": "completed", "tag": "5a931f59-eb56-4d86-86ee-de446155344c"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:19.242758 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-e9fb043f-b64e-4349-a388-8d7de4d9165c req-29f261ba-0d29-4e98-ab5b-452ae68b360f service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:19.243272 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-e9fb043f-b64e-4349-a388-8d7de4d9165c req-29f261ba-0d29-4e98-ab5b-452ae68b360f service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:19.254559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-e9fb043f-b64e-4349-a388-8d7de4d9165c req-29f261ba-0d29-4e98-ab5b-452ae68b360f service nova] Creating event network-vif-plugged:5a931f59-eb56-4d86-86ee-de446155344c for instance 2aca3a55-17cb-461a-ad99-5606410ac540 on hv-cinder-84890 Jul 14 12:21:19.268757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-e9fb043f-b64e-4349-a388-8d7de4d9165c req-29f261ba-0d29-4e98-ab5b-452ae68b360f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047772 Jul 14 12:21:19.269900 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 214/433] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:19.358102 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-01058e3f-0805-4855-96c4-71b42aa2c218 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:19.359277 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-01058e3f-0805-4855-96c4-71b42aa2c218 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:19.367488 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-01058e3f-0805-4855-96c4-71b42aa2c218 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:19.368332 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-01058e3f-0805-4855-96c4-71b42aa2c218 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:19.369802 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-01058e3f-0805-4855-96c4-71b42aa2c218 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:19.370457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-01058e3f-0805-4855-96c4-71b42aa2c218 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:19.508906 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-1257804c-fafc-49ca-8a14-a1cdd8f800bb tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:19.509782 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-1257804c-fafc-49ca-8a14-a1cdd8f800bb tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:19.516020 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1257804c-fafc-49ca-8a14-a1cdd8f800bb tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:19.516470 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1257804c-fafc-49ca-8a14-a1cdd8f800bb tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:19.517246 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1257804c-fafc-49ca-8a14-a1cdd8f800bb tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:19.517678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1257804c-fafc-49ca-8a14-a1cdd8f800bb tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:19.554506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-01058e3f-0805-4855-96c4-71b42aa2c218 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:19.564249 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-01058e3f-0805-4855-96c4-71b42aa2c218 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.209948 Jul 14 12:21:19.569494 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 220/434] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:19 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:19.770300 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-62750b36-2c6a-476c-ba22-f13f7d155ad7 req-0bec2986-64ee-4692-81db-f6c05be06a2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158005c6-a074-4abf-a8b8-7c1ee3250b2e", "tag": "ea14a717-a283-4fb9-92a3-043257ce7e6e"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:19.785893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-62750b36-2c6a-476c-ba22-f13f7d155ad7 req-0bec2986-64ee-4692-81db-f6c05be06a2c service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:19.786346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-62750b36-2c6a-476c-ba22-f13f7d155ad7 req-0bec2986-64ee-4692-81db-f6c05be06a2c service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:19.817424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-62750b36-2c6a-476c-ba22-f13f7d155ad7 req-0bec2986-64ee-4692-81db-f6c05be06a2c service nova] Creating event network-changed:ea14a717-a283-4fb9-92a3-043257ce7e6e for instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e on hv-cinder-84890 Jul 14 12:21:19.843085 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-62750b36-2c6a-476c-ba22-f13f7d155ad7 req-0bec2986-64ee-4692-81db-f6c05be06a2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058827 Jul 14 12:21:19.844476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 221/435] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:20.006434 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-bfd91a2a-17d6-4cd0-a703-3db9b62863f6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:20.007170 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-bfd91a2a-17d6-4cd0-a703-3db9b62863f6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:20.016499 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bfd91a2a-17d6-4cd0-a703-3db9b62863f6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:20.017513 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bfd91a2a-17d6-4cd0-a703-3db9b62863f6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:20.019011 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bfd91a2a-17d6-4cd0-a703-3db9b62863f6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:20.019953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bfd91a2a-17d6-4cd0-a703-3db9b62863f6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:20.022128 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:20.107519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-bfd91a2a-17d6-4cd0-a703-3db9b62863f6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:20.115360 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1257804c-fafc-49ca-8a14-a1cdd8f800bb tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:20.122991 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-bfd91a2a-17d6-4cd0-a703-3db9b62863f6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1316 microversion: 2.1 time: 0.121976 Jul 14 12:21:20.126401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-1257804c-fafc-49ca-8a14-a1cdd8f800bb tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.621913 Jul 14 12:21:20.135708 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 222/436] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:19 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1316 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:20.137502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 215/437] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:19 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:20.582636 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e7d97208-b075-44f1-91d4-9c888b89add2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:20.583772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e7d97208-b075-44f1-91d4-9c888b89add2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:20.595508 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e7d97208-b075-44f1-91d4-9c888b89add2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:20.597905 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e7d97208-b075-44f1-91d4-9c888b89add2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:20.599904 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e7d97208-b075-44f1-91d4-9c888b89add2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:20.600851 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e7d97208-b075-44f1-91d4-9c888b89add2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:20.799925 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e7d97208-b075-44f1-91d4-9c888b89add2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:20.810841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e7d97208-b075-44f1-91d4-9c888b89add2 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.232915 Jul 14 12:21:20.812052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 223/438] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:20 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:21.142894 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-488c3e88-a53d-4424-82ae-bdf599b6b0da tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:21.144127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-488c3e88-a53d-4424-82ae-bdf599b6b0da tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:21.144568 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-da03fc75-254b-461e-92d0-bddef00a8b4c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:21.145336 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-da03fc75-254b-461e-92d0-bddef00a8b4c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:21.147743 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:21.155535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-488c3e88-a53d-4424-82ae-bdf599b6b0da tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:21.160156 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da03fc75-254b-461e-92d0-bddef00a8b4c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:21.160703 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da03fc75-254b-461e-92d0-bddef00a8b4c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:21.161192 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-488c3e88-a53d-4424-82ae-bdf599b6b0da tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:21.162183 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-488c3e88-a53d-4424-82ae-bdf599b6b0da tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:21.162668 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da03fc75-254b-461e-92d0-bddef00a8b4c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:21.162975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-488c3e88-a53d-4424-82ae-bdf599b6b0da tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:21.163270 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da03fc75-254b-461e-92d0-bddef00a8b4c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:21.482550 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-da03fc75-254b-461e-92d0-bddef00a8b4c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:21.496304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-da03fc75-254b-461e-92d0-bddef00a8b4c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.353868 Jul 14 12:21:21.507894 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 224/439] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:21 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:21.514357 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-488c3e88-a53d-4424-82ae-bdf599b6b0da tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:21.523463 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-488c3e88-a53d-4424-82ae-bdf599b6b0da tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.384492 Jul 14 12:21:21.524147 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 216/440] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:21 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:21.832433 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-60051f63-d3b8-47a1-a36d-4d4f9e351549 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:21.833062 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-60051f63-d3b8-47a1-a36d-4d4f9e351549 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:21.842991 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-60051f63-d3b8-47a1-a36d-4d4f9e351549 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:21.843433 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-60051f63-d3b8-47a1-a36d-4d4f9e351549 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:21.844218 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-60051f63-d3b8-47a1-a36d-4d4f9e351549 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:21.844664 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-60051f63-d3b8-47a1-a36d-4d4f9e351549 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:21.891251 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-4f1f27f0-171d-4b73-aacd-71e4ec63aaf0 req-f160939c-3c59-475c-9244-9a8b033c89b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "905d8954-a633-4e05-a5eb-1bd833799fea", "tag": "97573f11-1cde-45f1-8103-8f5b45ac6f97"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:21.907447 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-4f1f27f0-171d-4b73-aacd-71e4ec63aaf0 req-f160939c-3c59-475c-9244-9a8b033c89b6 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:21.907836 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-4f1f27f0-171d-4b73-aacd-71e4ec63aaf0 req-f160939c-3c59-475c-9244-9a8b033c89b6 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:21.947830 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-4f1f27f0-171d-4b73-aacd-71e4ec63aaf0 req-f160939c-3c59-475c-9244-9a8b033c89b6 service nova] Creating event network-changed:97573f11-1cde-45f1-8103-8f5b45ac6f97 for instance 905d8954-a633-4e05-a5eb-1bd833799fea on hv-cinder-84890 Jul 14 12:21:21.959102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-4f1f27f0-171d-4b73-aacd-71e4ec63aaf0 req-f160939c-3c59-475c-9244-9a8b033c89b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071364 Jul 14 12:21:21.959700 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 217/441] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:21:22.093823 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-60051f63-d3b8-47a1-a36d-4d4f9e351549 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:22.113106 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-60051f63-d3b8-47a1-a36d-4d4f9e351549 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.288143 Jul 14 12:21:22.114148 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 225/442] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:21 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:22.515127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-fb0c522b-6835-42c1-997b-443bea09bd8d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:22.530783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-fb0c522b-6835-42c1-997b-443bea09bd8d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:22.530783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fb0c522b-6835-42c1-997b-443bea09bd8d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:22.530783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fb0c522b-6835-42c1-997b-443bea09bd8d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:22.530783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fb0c522b-6835-42c1-997b-443bea09bd8d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:22.531174 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fb0c522b-6835-42c1-997b-443bea09bd8d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:22.541568 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f4dd0bf1-dafb-4435-a123-762bbd6122dd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:22.543788 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f4dd0bf1-dafb-4435-a123-762bbd6122dd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:22.550998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:22.553439 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f4dd0bf1-dafb-4435-a123-762bbd6122dd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:22.554116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f4dd0bf1-dafb-4435-a123-762bbd6122dd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:22.555200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f4dd0bf1-dafb-4435-a123-762bbd6122dd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:22.556318 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f4dd0bf1-dafb-4435-a123-762bbd6122dd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:22.750380 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-fb0c522b-6835-42c1-997b-443bea09bd8d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:22.764236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-fb0c522b-6835-42c1-997b-443bea09bd8d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.253936 Jul 14 12:21:22.767746 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 218/443] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:22 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:22.839162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f4dd0bf1-dafb-4435-a123-762bbd6122dd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:22.879291 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f4dd0bf1-dafb-4435-a123-762bbd6122dd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.342027 Jul 14 12:21:22.879901 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 226/444] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:22 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:23.133607 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-96750876-e127-4415-8fa2-2fb8b323bd60 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:23.135490 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-96750876-e127-4415-8fa2-2fb8b323bd60 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:23.152715 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-96750876-e127-4415-8fa2-2fb8b323bd60 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:23.156067 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-96750876-e127-4415-8fa2-2fb8b323bd60 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:23.156914 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-96750876-e127-4415-8fa2-2fb8b323bd60 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:23.161958 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-96750876-e127-4415-8fa2-2fb8b323bd60 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:23.315187 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-96750876-e127-4415-8fa2-2fb8b323bd60 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:23.322967 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-96750876-e127-4415-8fa2-2fb8b323bd60 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.193368 Jul 14 12:21:23.323536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 219/445] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:23 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:23.799411 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-7c7954eb-e4cf-474b-9869-0825b28b73d9 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:23.800090 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-7c7954eb-e4cf-474b-9869-0825b28b73d9 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:23.813723 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7c7954eb-e4cf-474b-9869-0825b28b73d9 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:23.819437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7c7954eb-e4cf-474b-9869-0825b28b73d9 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:23.819437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7c7954eb-e4cf-474b-9869-0825b28b73d9 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:23.819437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7c7954eb-e4cf-474b-9869-0825b28b73d9 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:23.897943 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-1139b33b-a5b4-4136-8ecf-f893871a3024 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:23.900351 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-1139b33b-a5b4-4136-8ecf-f893871a3024 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:23.908392 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1139b33b-a5b4-4136-8ecf-f893871a3024 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:23.909294 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1139b33b-a5b4-4136-8ecf-f893871a3024 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:23.910535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1139b33b-a5b4-4136-8ecf-f893871a3024 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:23.911245 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1139b33b-a5b4-4136-8ecf-f893871a3024 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:24.045787 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-7c7954eb-e4cf-474b-9869-0825b28b73d9 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:24.052937 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=100 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:24.056276 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-7c7954eb-e4cf-474b-9869-0825b28b73d9 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.269162 Jul 14 12:21:24.071036 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 227/446] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:23 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:24.092684 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1139b33b-a5b4-4136-8ecf-f893871a3024 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:24.100011 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-1139b33b-a5b4-4136-8ecf-f893871a3024 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.206909 Jul 14 12:21:24.100586 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 220/447] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:23 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:24.340718 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d96ba7b4-ad6e-4ae1-ae19-6b87c996e203 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:24.341254 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d96ba7b4-ad6e-4ae1-ae19-6b87c996e203 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:24.347516 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d96ba7b4-ad6e-4ae1-ae19-6b87c996e203 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:24.347967 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d96ba7b4-ad6e-4ae1-ae19-6b87c996e203 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:24.348736 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d96ba7b4-ad6e-4ae1-ae19-6b87c996e203 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:24.349177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d96ba7b4-ad6e-4ae1-ae19-6b87c996e203 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:24.520396 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d96ba7b4-ad6e-4ae1-ae19-6b87c996e203 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:24.529478 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d96ba7b4-ad6e-4ae1-ae19-6b87c996e203 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.193323 Jul 14 12:21:24.530214 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 228/448] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:24 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:25.073548 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b51626c7-35a3-4c85-abc8-cd4d82ca23a1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:25.075159 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b51626c7-35a3-4c85-abc8-cd4d82ca23a1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:25.082659 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b51626c7-35a3-4c85-abc8-cd4d82ca23a1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:25.083240 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b51626c7-35a3-4c85-abc8-cd4d82ca23a1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:25.084225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b51626c7-35a3-4c85-abc8-cd4d82ca23a1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:25.085050 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b51626c7-35a3-4c85-abc8-cd4d82ca23a1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:25.114093 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:25.114890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=16 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:25.128575 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-027b8864-a064-48fb-9006-bd978bb81d54 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:25.129256 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-027b8864-a064-48fb-9006-bd978bb81d54 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:25.137982 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-027b8864-a064-48fb-9006-bd978bb81d54 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:25.138853 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-027b8864-a064-48fb-9006-bd978bb81d54 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:25.139870 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-027b8864-a064-48fb-9006-bd978bb81d54 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:25.140522 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-027b8864-a064-48fb-9006-bd978bb81d54 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:25.245640 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b51626c7-35a3-4c85-abc8-cd4d82ca23a1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:25.255293 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b51626c7-35a3-4c85-abc8-cd4d82ca23a1 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.185731 Jul 14 12:21:25.262229 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 221/449] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:25 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:25.350048 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-027b8864-a064-48fb-9006-bd978bb81d54 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:25.360033 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-027b8864-a064-48fb-9006-bd978bb81d54 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.246219 Jul 14 12:21:25.360672 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 229/450] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:25 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:25.549076 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c98e800b-4b2a-4468-92ea-5ec7e9f2ee4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:25.549694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c98e800b-4b2a-4468-92ea-5ec7e9f2ee4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:25.551586 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:25.556949 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c98e800b-4b2a-4468-92ea-5ec7e9f2ee4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:25.560490 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c98e800b-4b2a-4468-92ea-5ec7e9f2ee4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:25.560490 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c98e800b-4b2a-4468-92ea-5ec7e9f2ee4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:25.560490 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c98e800b-4b2a-4468-92ea-5ec7e9f2ee4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:25.669997 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=16 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:25.704603 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c98e800b-4b2a-4468-92ea-5ec7e9f2ee4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:25.716039 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c98e800b-4b2a-4468-92ea-5ec7e9f2ee4d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.171367 Jul 14 12:21:25.717060 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 222/451] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:25 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:26.271832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-45845b71-034b-448e-b0b5-07a8bbd72f9c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:26.272561 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-45845b71-034b-448e-b0b5-07a8bbd72f9c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:26.280837 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45845b71-034b-448e-b0b5-07a8bbd72f9c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:26.281285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45845b71-034b-448e-b0b5-07a8bbd72f9c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:26.282064 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45845b71-034b-448e-b0b5-07a8bbd72f9c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:26.282499 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45845b71-034b-448e-b0b5-07a8bbd72f9c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:26.379672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-02ecc98c-6890-461c-a526-bc1803ee1805 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:26.380293 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-02ecc98c-6890-461c-a526-bc1803ee1805 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:26.389617 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-02ecc98c-6890-461c-a526-bc1803ee1805 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:26.390313 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-02ecc98c-6890-461c-a526-bc1803ee1805 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:26.391564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-02ecc98c-6890-461c-a526-bc1803ee1805 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:26.392084 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-02ecc98c-6890-461c-a526-bc1803ee1805 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:26.435602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-45845b71-034b-448e-b0b5-07a8bbd72f9c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:26.447127 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-45845b71-034b-448e-b0b5-07a8bbd72f9c tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.179024 Jul 14 12:21:26.449989 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 230/452] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:26 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:26.608222 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-02ecc98c-6890-461c-a526-bc1803ee1805 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:26.628842 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-02ecc98c-6890-461c-a526-bc1803ee1805 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.254557 Jul 14 12:21:26.641908 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 223/453] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:26 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:26.734960 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a8250490-226a-4a4c-be1f-041a44b2c3fb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:26.736440 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a8250490-226a-4a4c-be1f-041a44b2c3fb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:26.744238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a8250490-226a-4a4c-be1f-041a44b2c3fb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:26.748789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a8250490-226a-4a4c-be1f-041a44b2c3fb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:26.748789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a8250490-226a-4a4c-be1f-041a44b2c3fb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:26.748789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a8250490-226a-4a4c-be1f-041a44b2c3fb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:26.895496 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a8250490-226a-4a4c-be1f-041a44b2c3fb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:26.908418 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a8250490-226a-4a4c-be1f-041a44b2c3fb tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.177564 Jul 14 12:21:26.909724 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 231/454] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:26 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:27.465698 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-df01606f-8e73-43b9-9813-724aaca28f48 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:27.468199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-df01606f-8e73-43b9-9813-724aaca28f48 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:27.474588 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-df01606f-8e73-43b9-9813-724aaca28f48 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:27.475354 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-df01606f-8e73-43b9-9813-724aaca28f48 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:27.476401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-df01606f-8e73-43b9-9813-724aaca28f48 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:27.477025 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-df01606f-8e73-43b9-9813-724aaca28f48 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:27.649525 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6b9707ec-f7b2-491e-b02c-e7d0bc77b789 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:27.650427 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6b9707ec-f7b2-491e-b02c-e7d0bc77b789 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:27.665347 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6b9707ec-f7b2-491e-b02c-e7d0bc77b789 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:27.665878 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6b9707ec-f7b2-491e-b02c-e7d0bc77b789 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:27.666677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6b9707ec-f7b2-491e-b02c-e7d0bc77b789 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:27.667151 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6b9707ec-f7b2-491e-b02c-e7d0bc77b789 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:27.763403 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-df01606f-8e73-43b9-9813-724aaca28f48 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:27.772039 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-df01606f-8e73-43b9-9813-724aaca28f48 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.310317 Jul 14 12:21:27.772623 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 224/455] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:27 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:27.877364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6b9707ec-f7b2-491e-b02c-e7d0bc77b789 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:27.886550 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6b9707ec-f7b2-491e-b02c-e7d0bc77b789 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.240952 Jul 14 12:21:27.895213 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 232/456] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:27 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:27.925751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f6b2a9f4-784e-479f-a6f7-807116b80d03 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:27.926514 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f6b2a9f4-784e-479f-a6f7-807116b80d03 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:27.933263 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f6b2a9f4-784e-479f-a6f7-807116b80d03 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:27.933999 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f6b2a9f4-784e-479f-a6f7-807116b80d03 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:27.935199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f6b2a9f4-784e-479f-a6f7-807116b80d03 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:27.943417 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f6b2a9f4-784e-479f-a6f7-807116b80d03 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:28.117459 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f6b2a9f4-784e-479f-a6f7-807116b80d03 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:28.131574 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f6b2a9f4-784e-479f-a6f7-807116b80d03 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.209961 Jul 14 12:21:28.137447 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 225/457] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:27 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:28.790995 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-09257b4a-e036-46e1-bba1-1c4b22772bd2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:28.791772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-09257b4a-e036-46e1-bba1-1c4b22772bd2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:28.798524 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-09257b4a-e036-46e1-bba1-1c4b22772bd2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:28.799006 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-09257b4a-e036-46e1-bba1-1c4b22772bd2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:28.799795 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-09257b4a-e036-46e1-bba1-1c4b22772bd2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:28.800243 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-09257b4a-e036-46e1-bba1-1c4b22772bd2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:28.906881 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7037aa26-b8fd-440f-825e-f5f23a41f6fd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:28.907530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7037aa26-b8fd-440f-825e-f5f23a41f6fd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:28.916746 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7037aa26-b8fd-440f-825e-f5f23a41f6fd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:28.917711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7037aa26-b8fd-440f-825e-f5f23a41f6fd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:28.919297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7037aa26-b8fd-440f-825e-f5f23a41f6fd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:28.920225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7037aa26-b8fd-440f-825e-f5f23a41f6fd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:28.950859 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-09257b4a-e036-46e1-bba1-1c4b22772bd2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:28.964629 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-09257b4a-e036-46e1-bba1-1c4b22772bd2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.178465 Jul 14 12:21:28.965888 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 233/458] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:28 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:29.071869 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7037aa26-b8fd-440f-825e-f5f23a41f6fd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:29.079397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7037aa26-b8fd-440f-825e-f5f23a41f6fd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.176694 Jul 14 12:21:29.083812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 226/459] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:28 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:29.155205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6fb032d5-9e73-4364-97e4-9e3f75234706 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:29.155811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6fb032d5-9e73-4364-97e4-9e3f75234706 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:29.161914 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6fb032d5-9e73-4364-97e4-9e3f75234706 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:29.162354 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6fb032d5-9e73-4364-97e4-9e3f75234706 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:29.163156 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6fb032d5-9e73-4364-97e4-9e3f75234706 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:29.163619 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6fb032d5-9e73-4364-97e4-9e3f75234706 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:29.298707 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6fb032d5-9e73-4364-97e4-9e3f75234706 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:29.306028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6fb032d5-9e73-4364-97e4-9e3f75234706 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.154632 Jul 14 12:21:29.306651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 234/460] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:29 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:29.982232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7707c74d-d458-4332-b7e4-ec5b3e797159 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:29.983535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7707c74d-d458-4332-b7e4-ec5b3e797159 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:29.990038 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7707c74d-d458-4332-b7e4-ec5b3e797159 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:29.990481 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7707c74d-d458-4332-b7e4-ec5b3e797159 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:29.991301 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7707c74d-d458-4332-b7e4-ec5b3e797159 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:29.991728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7707c74d-d458-4332-b7e4-ec5b3e797159 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:30.095561 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cfc4a846-913c-49ff-ae5a-517ad5c03768 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:30.096174 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-cfc4a846-913c-49ff-ae5a-517ad5c03768 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:30.103415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfc4a846-913c-49ff-ae5a-517ad5c03768 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:30.103957 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfc4a846-913c-49ff-ae5a-517ad5c03768 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:30.104728 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfc4a846-913c-49ff-ae5a-517ad5c03768 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:30.105214 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cfc4a846-913c-49ff-ae5a-517ad5c03768 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:30.239725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-cfc4a846-913c-49ff-ae5a-517ad5c03768 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:30.247120 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cfc4a846-913c-49ff-ae5a-517ad5c03768 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.155391 Jul 14 12:21:30.247695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 235/461] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:30 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:30.258675 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7707c74d-d458-4332-b7e4-ec5b3e797159 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:30.266985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7707c74d-d458-4332-b7e4-ec5b3e797159 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.288995 Jul 14 12:21:30.267943 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 227/462] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:29 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:30.323187 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6deb1af2-0d80-42c4-ace1-7bb4acbc47af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:30.323890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6deb1af2-0d80-42c4-ace1-7bb4acbc47af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:30.330274 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6deb1af2-0d80-42c4-ace1-7bb4acbc47af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:30.330733 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6deb1af2-0d80-42c4-ace1-7bb4acbc47af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:30.331720 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6deb1af2-0d80-42c4-ace1-7bb4acbc47af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:30.332290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6deb1af2-0d80-42c4-ace1-7bb4acbc47af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:30.463419 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6deb1af2-0d80-42c4-ace1-7bb4acbc47af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:30.470718 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6deb1af2-0d80-42c4-ace1-7bb4acbc47af tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.151994 Jul 14 12:21:30.471306 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 236/463] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:30 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:30.692671 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-142255853", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "networks": [{"uuid": "b7c77089-f3cd-4ab0-9a84-cc1746e2d34c"}]}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:30.757330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] validate_networks() for [('b7c77089-f3cd-4ab0-9a84-cc1746e2d34c', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:21:31.216256 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-70a17e00-66d3-407b-b389-f238b11c9581 req-cb6ecf52-9eb9-448c-bebb-57384bc8e6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357e6fda-615e-4e1a-9f33-552398705e3e", "tag": "8d1d4c31-5832-429c-8506-0433ac2a974b"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:31.224818 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-70a17e00-66d3-407b-b389-f238b11c9581 req-cb6ecf52-9eb9-448c-bebb-57384bc8e6b4 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.225365 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-70a17e00-66d3-407b-b389-f238b11c9581 req-cb6ecf52-9eb9-448c-bebb-57384bc8e6b4 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.238237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-70a17e00-66d3-407b-b389-f238b11c9581 req-cb6ecf52-9eb9-448c-bebb-57384bc8e6b4 service nova] Creating event network-changed:8d1d4c31-5832-429c-8506-0433ac2a974b for instance 357e6fda-615e-4e1a-9f33-552398705e3e on hv-cinder-84890 Jul 14 12:21:31.243866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-70a17e00-66d3-407b-b389-f238b11c9581 req-cb6ecf52-9eb9-448c-bebb-57384bc8e6b4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032397 Jul 14 12:21:31.244689 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 237/464] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:21:31.265568 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4ffe4a68-c77a-47a3-93a2-b3e249842134 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:31.266347 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4ffe4a68-c77a-47a3-93a2-b3e249842134 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:31.273038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4ffe4a68-c77a-47a3-93a2-b3e249842134 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.273490 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4ffe4a68-c77a-47a3-93a2-b3e249842134 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.280932 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4ffe4a68-c77a-47a3-93a2-b3e249842134 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.280932 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4ffe4a68-c77a-47a3-93a2-b3e249842134 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.369452 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:21:31.369941 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:21:31.370368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:21:31.370838 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:21:31.371252 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:21:31.381595 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.382313 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.384352 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.384797 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.402118 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Getting quotas for project bae52c2cdf124894a541a6b7407eb23c. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:21:31.406105 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Getting quotas for user ea504bdceb7b4a1b8109c658e133f955 and project bae52c2cdf124894a541a6b7407eb23c. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:21:31.417936 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:21:31.418113 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4ffe4a68-c77a-47a3-93a2-b3e249842134 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:31.420264 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:21:31.425667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4ffe4a68-c77a-47a3-93a2-b3e249842134 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.164544 Jul 14 12:21:31.434117 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 238/465] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:31 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:31.440968 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e82a859e-201f-446f-af0f-3b72f31a03fa tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:31.441582 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e82a859e-201f-446f-af0f-3b72f31a03fa tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:31.448102 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e82a859e-201f-446f-af0f-3b72f31a03fa tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.448556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e82a859e-201f-446f-af0f-3b72f31a03fa tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.449331 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e82a859e-201f-446f-af0f-3b72f31a03fa tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.449798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e82a859e-201f-446f-af0f-3b72f31a03fa tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.573264 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8f380be3-3f03-4ffe-a19a-56adfb9f5bf8 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.884600 Jul 14 12:21:31.579337 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 228/466] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:21:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:21:31.579614 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e82a859e-201f-446f-af0f-3b72f31a03fa tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:31.585266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-853529da-28ee-4a97-b184-b795cf922757 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:31.585879 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-853529da-28ee-4a97-b184-b795cf922757 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:31.588236 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e82a859e-201f-446f-af0f-3b72f31a03fa tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1314 microversion: 2.1 time: 0.151521 Jul 14 12:21:31.588517 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 239/467] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:31 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:31.593051 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-853529da-28ee-4a97-b184-b795cf922757 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.593503 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-853529da-28ee-4a97-b184-b795cf922757 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.594084 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f96c566d-47b6-43ab-b655-67e1097b7944 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:31.594273 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-853529da-28ee-4a97-b184-b795cf922757 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.594708 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-853529da-28ee-4a97-b184-b795cf922757 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.594916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f96c566d-47b6-43ab-b655-67e1097b7944 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:31.660428 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f96c566d-47b6-43ab-b655-67e1097b7944 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:31.669708 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f96c566d-47b6-43ab-b655-67e1097b7944 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1218 microversion: 2.1 time: 0.079959 Jul 14 12:21:31.674819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 240/468] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:31 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:31.755953 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-853529da-28ee-4a97-b184-b795cf922757 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:31.764469 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-853529da-28ee-4a97-b184-b795cf922757 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.189238 Jul 14 12:21:31.765120 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 229/469] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:31 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:31.862919 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-97919097-40c7-47b3-90b8-69e5fc73c7d7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:31.863443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-97919097-40c7-47b3-90b8-69e5fc73c7d7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:31.870706 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-97919097-40c7-47b3-90b8-69e5fc73c7d7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.871183 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-97919097-40c7-47b3-90b8-69e5fc73c7d7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.871965 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-97919097-40c7-47b3-90b8-69e5fc73c7d7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:31.872411 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-97919097-40c7-47b3-90b8-69e5fc73c7d7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:31.896911 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-97919097-40c7-47b3-90b8-69e5fc73c7d7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/ips" status: 200 len: 149 microversion: 2.20 time: 0.038970 Jul 14 12:21:31.897670 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 241/470] 10.222.0.27 () {60 vars in 1288 bytes} [Thu Jul 14 12:21:31 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:21:32.442944 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-06cfe820-7836-49f5-b197-c6e3e2b463c5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:32.443580 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-06cfe820-7836-49f5-b197-c6e3e2b463c5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:32.450884 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-06cfe820-7836-49f5-b197-c6e3e2b463c5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:32.451327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-06cfe820-7836-49f5-b197-c6e3e2b463c5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:32.452661 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-06cfe820-7836-49f5-b197-c6e3e2b463c5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:32.452661 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-06cfe820-7836-49f5-b197-c6e3e2b463c5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:32.585391 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-06cfe820-7836-49f5-b197-c6e3e2b463c5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:32.594432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-06cfe820-7836-49f5-b197-c6e3e2b463c5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.155212 Jul 14 12:21:32.604340 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 230/471] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:32 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:32.604866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4724e2ee-dc97-498e-a8f4-f5d767019d21 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:32.604866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4724e2ee-dc97-498e-a8f4-f5d767019d21 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:32.611563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4724e2ee-dc97-498e-a8f4-f5d767019d21 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:32.612019 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4724e2ee-dc97-498e-a8f4-f5d767019d21 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:32.612793 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4724e2ee-dc97-498e-a8f4-f5d767019d21 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:32.613238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4724e2ee-dc97-498e-a8f4-f5d767019d21 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:32.687601 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-82937f55-978b-4978-9a65-3010ff383239 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:32.688213 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-82937f55-978b-4978-9a65-3010ff383239 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:32.694303 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82937f55-978b-4978-9a65-3010ff383239 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:32.694751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82937f55-978b-4978-9a65-3010ff383239 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:32.695550 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82937f55-978b-4978-9a65-3010ff383239 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:32.696256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82937f55-978b-4978-9a65-3010ff383239 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:32.753652 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4724e2ee-dc97-498e-a8f4-f5d767019d21 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:32.765597 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4724e2ee-dc97-498e-a8f4-f5d767019d21 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1462 microversion: 2.1 time: 0.161146 Jul 14 12:21:32.765597 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 242/472] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:32 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1462 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:32.765885 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-82937f55-978b-4978-9a65-3010ff383239 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:32.770715 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-82937f55-978b-4978-9a65-3010ff383239 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1222 microversion: 2.1 time: 0.087054 Jul 14 12:21:32.771299 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 231/473] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:32 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:32.781500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-25a598c2-71d1-4a3b-a383-42bc557caafd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:32.782959 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-25a598c2-71d1-4a3b-a383-42bc557caafd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:32.788287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-25a598c2-71d1-4a3b-a383-42bc557caafd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:32.788796 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-25a598c2-71d1-4a3b-a383-42bc557caafd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:32.789558 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-25a598c2-71d1-4a3b-a383-42bc557caafd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:32.790547 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-25a598c2-71d1-4a3b-a383-42bc557caafd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:32.806556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-03578b2c-17ed-4a13-8602-33dde938da75 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:32.807079 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-03578b2c-17ed-4a13-8602-33dde938da75 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:32.813085 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03578b2c-17ed-4a13-8602-33dde938da75 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:32.813531 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03578b2c-17ed-4a13-8602-33dde938da75 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:32.814290 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03578b2c-17ed-4a13-8602-33dde938da75 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:32.814721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03578b2c-17ed-4a13-8602-33dde938da75 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:32.839428 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-03578b2c-17ed-4a13-8602-33dde938da75 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Going to try to terminate instance {{(pid=118263) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:21:32.925037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-25a598c2-71d1-4a3b-a383-42bc557caafd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:32.936009 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-25a598c2-71d1-4a3b-a383-42bc557caafd tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.157162 Jul 14 12:21:32.936009 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 243/474] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:32 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:33.263810 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-03578b2c-17ed-4a13-8602-33dde938da75 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "DELETE /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 204 len: 0 microversion: 2.1 time: 0.461521 Jul 14 12:21:33.264687 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 232/475] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:21:32 2022] DELETE /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 12:21:33.273059 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4b69e569-25d5-4450-a63f-0570a29a798d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:33.273678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4b69e569-25d5-4450-a63f-0570a29a798d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:33.280530 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4b69e569-25d5-4450-a63f-0570a29a798d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:33.280992 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4b69e569-25d5-4450-a63f-0570a29a798d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:33.281784 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4b69e569-25d5-4450-a63f-0570a29a798d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:33.282223 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4b69e569-25d5-4450-a63f-0570a29a798d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:33.413281 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4b69e569-25d5-4450-a63f-0570a29a798d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:33.421343 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4b69e569-25d5-4450-a63f-0570a29a798d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1468 microversion: 2.1 time: 0.152257 Jul 14 12:21:33.421913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 244/476] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:33 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1468 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:33.612396 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4afaa28b-b0dc-4432-989c-f98b2a430c0c tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:33.613081 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4afaa28b-b0dc-4432-989c-f98b2a430c0c tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:33.620375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4afaa28b-b0dc-4432-989c-f98b2a430c0c tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:33.620823 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4afaa28b-b0dc-4432-989c-f98b2a430c0c tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:33.621595 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4afaa28b-b0dc-4432-989c-f98b2a430c0c tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:33.622039 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4afaa28b-b0dc-4432-989c-f98b2a430c0c tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:33.754692 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4afaa28b-b0dc-4432-989c-f98b2a430c0c tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:33.762559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4afaa28b-b0dc-4432-989c-f98b2a430c0c tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.154475 Jul 14 12:21:33.763170 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 233/477] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:33 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:33.787340 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-264e7baa-e712-4aec-85d7-36873d2719d5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:33.787957 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-264e7baa-e712-4aec-85d7-36873d2719d5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:33.795175 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-264e7baa-e712-4aec-85d7-36873d2719d5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:33.795626 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-264e7baa-e712-4aec-85d7-36873d2719d5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:33.796420 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-264e7baa-e712-4aec-85d7-36873d2719d5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:33.796857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-264e7baa-e712-4aec-85d7-36873d2719d5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:33.861161 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-264e7baa-e712-4aec-85d7-36873d2719d5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:33.868804 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-264e7baa-e712-4aec-85d7-36873d2719d5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1214 microversion: 2.1 time: 0.085199 Jul 14 12:21:33.869321 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 245/478] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:33 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:33.951533 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cf4530a9-bb13-49ff-8050-f0cdeef27ef7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:33.952147 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-cf4530a9-bb13-49ff-8050-f0cdeef27ef7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:33.958458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cf4530a9-bb13-49ff-8050-f0cdeef27ef7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:33.959052 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cf4530a9-bb13-49ff-8050-f0cdeef27ef7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:33.959826 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cf4530a9-bb13-49ff-8050-f0cdeef27ef7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:33.960296 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cf4530a9-bb13-49ff-8050-f0cdeef27ef7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.088708 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-cf4530a9-bb13-49ff-8050-f0cdeef27ef7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:34.096088 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-cf4530a9-bb13-49ff-8050-f0cdeef27ef7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.148447 Jul 14 12:21:34.096649 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 234/479] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:33 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:34.232820 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0799c196-a45a-4032-8aeb-816a01da6a0c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:34.233351 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0799c196-a45a-4032-8aeb-816a01da6a0c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:34.239406 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0799c196-a45a-4032-8aeb-816a01da6a0c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:34.239857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0799c196-a45a-4032-8aeb-816a01da6a0c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.240610 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0799c196-a45a-4032-8aeb-816a01da6a0c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:34.241044 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0799c196-a45a-4032-8aeb-816a01da6a0c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.257205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=100 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:34.263720 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-0799c196-a45a-4032-8aeb-816a01da6a0c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lazy-loading 'flavor' on Instance uuid 4d88a179-83e5-4361-8948-8a2632512eaf {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:21:34.439480 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5b82f921-ad4a-4cfd-a891-4c77c4159960 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:34.440086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5b82f921-ad4a-4cfd-a891-4c77c4159960 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:34.446633 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5b82f921-ad4a-4cfd-a891-4c77c4159960 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:34.447209 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5b82f921-ad4a-4cfd-a891-4c77c4159960 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.447959 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5b82f921-ad4a-4cfd-a891-4c77c4159960 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:34.448392 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5b82f921-ad4a-4cfd-a891-4c77c4159960 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.577754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5b82f921-ad4a-4cfd-a891-4c77c4159960 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:34.585277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5b82f921-ad4a-4cfd-a891-4c77c4159960 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1468 microversion: 2.1 time: 0.149611 Jul 14 12:21:34.585873 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 235/480] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:34 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1468 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:34.779447 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c2c79dfb-9420-47eb-83ec-81e9aa47b350 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:34.781031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c2c79dfb-9420-47eb-83ec-81e9aa47b350 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:34.787873 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c2c79dfb-9420-47eb-83ec-81e9aa47b350 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:34.788478 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c2c79dfb-9420-47eb-83ec-81e9aa47b350 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.789323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c2c79dfb-9420-47eb-83ec-81e9aa47b350 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:34.790420 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c2c79dfb-9420-47eb-83ec-81e9aa47b350 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.829669 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0799c196-a45a-4032-8aeb-816a01da6a0c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "POST /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/action" status: 202 len: 0 microversion: 2.20 time: 0.600539 Jul 14 12:21:34.830813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 246/481] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jul 14 12:21:34 2022] POST /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/action => generated 0 bytes in 602 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:21:34.839007 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d059fad3-d20e-40a9-813c-f0a5582e9615 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:34.839935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d059fad3-d20e-40a9-813c-f0a5582e9615 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:34.846725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d059fad3-d20e-40a9-813c-f0a5582e9615 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:34.847260 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d059fad3-d20e-40a9-813c-f0a5582e9615 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.848038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d059fad3-d20e-40a9-813c-f0a5582e9615 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:34.848476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d059fad3-d20e-40a9-813c-f0a5582e9615 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.934155 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c2c79dfb-9420-47eb-83ec-81e9aa47b350 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:34.941978 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c2c79dfb-9420-47eb-83ec-81e9aa47b350 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.166233 Jul 14 12:21:34.942559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 236/482] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:34 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:34.953702 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-733ebd9c-8c1c-48e8-9d56-ebbab6be0f8a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:34.956237 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-733ebd9c-8c1c-48e8-9d56-ebbab6be0f8a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:34.960478 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-733ebd9c-8c1c-48e8-9d56-ebbab6be0f8a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:34.960925 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-733ebd9c-8c1c-48e8-9d56-ebbab6be0f8a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.961842 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-733ebd9c-8c1c-48e8-9d56-ebbab6be0f8a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:34.962274 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-733ebd9c-8c1c-48e8-9d56-ebbab6be0f8a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:34.967955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:34.989188 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d059fad3-d20e-40a9-813c-f0a5582e9615 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:35.007176 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d059fad3-d20e-40a9-813c-f0a5582e9615 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:35.008915 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d059fad3-d20e-40a9-813c-f0a5582e9615 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:35.010185 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d059fad3-d20e-40a9-813c-f0a5582e9615 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.175425 Jul 14 12:21:35.022299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 247/483] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:34 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:35.079403 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-733ebd9c-8c1c-48e8-9d56-ebbab6be0f8a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:35.088366 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-733ebd9c-8c1c-48e8-9d56-ebbab6be0f8a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1214 microversion: 2.1 time: 0.139391 Jul 14 12:21:35.088899 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 237/484] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:34 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:35.112955 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e9dcd99f-bb35-4307-83d2-a4b4b93263a7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:35.113718 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e9dcd99f-bb35-4307-83d2-a4b4b93263a7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:35.123200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9dcd99f-bb35-4307-83d2-a4b4b93263a7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:35.123652 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9dcd99f-bb35-4307-83d2-a4b4b93263a7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:35.125743 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9dcd99f-bb35-4307-83d2-a4b4b93263a7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:35.126243 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9dcd99f-bb35-4307-83d2-a4b4b93263a7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:35.273090 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e9dcd99f-bb35-4307-83d2-a4b4b93263a7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:35.281133 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e9dcd99f-bb35-4307-83d2-a4b4b93263a7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.172170 Jul 14 12:21:35.281909 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 248/485] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:35 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:35.602948 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5433098d-4d18-4884-8a93-569154767d1b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:35.603346 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5433098d-4d18-4884-8a93-569154767d1b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:35.609773 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5433098d-4d18-4884-8a93-569154767d1b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:35.610220 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5433098d-4d18-4884-8a93-569154767d1b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:35.611009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5433098d-4d18-4884-8a93-569154767d1b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:35.611444 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5433098d-4d18-4884-8a93-569154767d1b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:35.813401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5433098d-4d18-4884-8a93-569154767d1b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:35.822270 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5433098d-4d18-4884-8a93-569154767d1b tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1468 microversion: 2.1 time: 0.223819 Jul 14 12:21:35.823236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 238/486] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:35 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1468 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:35.958994 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-091647a6-e297-4096-a127-cd8cef47cd8a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:35.959592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-091647a6-e297-4096-a127-cd8cef47cd8a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:35.966314 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-091647a6-e297-4096-a127-cd8cef47cd8a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:35.966779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-091647a6-e297-4096-a127-cd8cef47cd8a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:35.967553 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-091647a6-e297-4096-a127-cd8cef47cd8a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:35.967985 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-091647a6-e297-4096-a127-cd8cef47cd8a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:36.030009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f7f2fbcc-2fd1-416c-b21b-811c67cb31e3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:36.030669 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f7f2fbcc-2fd1-416c-b21b-811c67cb31e3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:36.036675 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f7f2fbcc-2fd1-416c-b21b-811c67cb31e3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:36.037240 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f7f2fbcc-2fd1-416c-b21b-811c67cb31e3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:36.038376 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f7f2fbcc-2fd1-416c-b21b-811c67cb31e3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:36.039036 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f7f2fbcc-2fd1-416c-b21b-811c67cb31e3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:36.110910 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-091647a6-e297-4096-a127-cd8cef47cd8a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:36.120911 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-091647a6-e297-4096-a127-cd8cef47cd8a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.165699 Jul 14 12:21:36.121512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 249/487] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:35 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:36.126213 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8abe91c9-c75a-4ec6-a8f8-9403724cab9d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:36.127052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8abe91c9-c75a-4ec6-a8f8-9403724cab9d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:36.134185 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8abe91c9-c75a-4ec6-a8f8-9403724cab9d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:36.134637 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8abe91c9-c75a-4ec6-a8f8-9403724cab9d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:36.135476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8abe91c9-c75a-4ec6-a8f8-9403724cab9d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:36.136075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8abe91c9-c75a-4ec6-a8f8-9403724cab9d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:36.208646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8abe91c9-c75a-4ec6-a8f8-9403724cab9d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:36.216817 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8abe91c9-c75a-4ec6-a8f8-9403724cab9d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1278 microversion: 2.1 time: 0.094090 Jul 14 12:21:36.227265 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 250/488] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:36 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1278 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:36.299115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b46238ba-5808-43e1-8935-a4ba2ed4fe51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:36.299748 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b46238ba-5808-43e1-8935-a4ba2ed4fe51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:36.307632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b46238ba-5808-43e1-8935-a4ba2ed4fe51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:36.308145 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b46238ba-5808-43e1-8935-a4ba2ed4fe51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:36.308936 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b46238ba-5808-43e1-8935-a4ba2ed4fe51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:36.309579 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b46238ba-5808-43e1-8935-a4ba2ed4fe51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:36.415026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f7f2fbcc-2fd1-416c-b21b-811c67cb31e3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:36.429812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f7f2fbcc-2fd1-416c-b21b-811c67cb31e3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:36.429812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f7f2fbcc-2fd1-416c-b21b-811c67cb31e3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:36.429812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f7f2fbcc-2fd1-416c-b21b-811c67cb31e3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.401240 Jul 14 12:21:36.430491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 239/489] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:36 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:36.434713 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-d1474827-a235-4c7e-9b7f-a3c671ea81bf req-24da7b9b-e9d2-4ab2-b73f-c0fecb01fc0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aca3a55-17cb-461a-ad99-5606410ac540", "name": "network-vif-deleted", "tag": "5a931f59-eb56-4d86-86ee-de446155344c"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:36.443026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-d1474827-a235-4c7e-9b7f-a3c671ea81bf req-24da7b9b-e9d2-4ab2-b73f-c0fecb01fc0b service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:36.443476 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-d1474827-a235-4c7e-9b7f-a3c671ea81bf req-24da7b9b-e9d2-4ab2-b73f-c0fecb01fc0b service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:36.455560 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-d1474827-a235-4c7e-9b7f-a3c671ea81bf req-24da7b9b-e9d2-4ab2-b73f-c0fecb01fc0b service nova] Creating event network-vif-deleted:5a931f59-eb56-4d86-86ee-de446155344c for instance 2aca3a55-17cb-461a-ad99-5606410ac540 on hv-cinder-84890 Jul 14 12:21:36.461058 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-d1474827-a235-4c7e-9b7f-a3c671ea81bf req-24da7b9b-e9d2-4ab2-b73f-c0fecb01fc0b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031665 Jul 14 12:21:36.461587 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b46238ba-5808-43e1-8935-a4ba2ed4fe51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:36.462597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 240/490] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:36.470604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b46238ba-5808-43e1-8935-a4ba2ed4fe51 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.175942 Jul 14 12:21:36.471235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 251/491] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:36 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:36.842077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f98c26ad-3a81-4a67-9e67-27b5b41179e2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:36.842968 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f98c26ad-3a81-4a67-9e67-27b5b41179e2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:36.849234 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f98c26ad-3a81-4a67-9e67-27b5b41179e2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:36.849761 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f98c26ad-3a81-4a67-9e67-27b5b41179e2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:36.850552 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f98c26ad-3a81-4a67-9e67-27b5b41179e2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:36.851020 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f98c26ad-3a81-4a67-9e67-27b5b41179e2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:36.924257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f98c26ad-3a81-4a67-9e67-27b5b41179e2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:36.931867 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f98c26ad-3a81-4a67-9e67-27b5b41179e2 tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1299 microversion: 2.1 time: 0.095131 Jul 14 12:21:36.934524 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 241/492] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:36 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:37.139765 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2b52c259-ce23-48ed-b558-78bce9283de7 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:37.140453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2b52c259-ce23-48ed-b558-78bce9283de7 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:37.148444 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b52c259-ce23-48ed-b558-78bce9283de7 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.148928 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b52c259-ce23-48ed-b558-78bce9283de7 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.150320 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b52c259-ce23-48ed-b558-78bce9283de7 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.151257 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b52c259-ce23-48ed-b558-78bce9283de7 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.234630 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f0bc264b-1f9a-4e87-b209-d1c61be564ff tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:37.235371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f0bc264b-1f9a-4e87-b209-d1c61be564ff tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:37.241541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f0bc264b-1f9a-4e87-b209-d1c61be564ff tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.242010 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f0bc264b-1f9a-4e87-b209-d1c61be564ff tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.243976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f0bc264b-1f9a-4e87-b209-d1c61be564ff tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.244601 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f0bc264b-1f9a-4e87-b209-d1c61be564ff tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.282588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2b52c259-ce23-48ed-b558-78bce9283de7 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:37.291727 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2b52c259-ce23-48ed-b558-78bce9283de7 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.158077 Jul 14 12:21:37.292311 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 252/493] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:37 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:37.374831 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f0bc264b-1f9a-4e87-b209-d1c61be564ff tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:37.382699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f0bc264b-1f9a-4e87-b209-d1c61be564ff tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.151956 Jul 14 12:21:37.383816 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 242/494] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:37 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:37.388535 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-78860ecb-634c-4543-9a45-e27357f8b7e0 req-2d77db6f-3d1e-4784-ac4d-336e16a3f9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158005c6-a074-4abf-a8b8-7c1ee3250b2e", "name": "network-vif-plugged", "status": "completed", "tag": "ea14a717-a283-4fb9-92a3-043257ce7e6e"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:37.397476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-78860ecb-634c-4543-9a45-e27357f8b7e0 req-2d77db6f-3d1e-4784-ac4d-336e16a3f9c5 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.397922 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-78860ecb-634c-4543-9a45-e27357f8b7e0 req-2d77db6f-3d1e-4784-ac4d-336e16a3f9c5 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.409430 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-78860ecb-634c-4543-9a45-e27357f8b7e0 req-2d77db6f-3d1e-4784-ac4d-336e16a3f9c5 service nova] Creating event network-vif-plugged:ea14a717-a283-4fb9-92a3-043257ce7e6e for instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e on hv-cinder-84890 Jul 14 12:21:37.414115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-78860ecb-634c-4543-9a45-e27357f8b7e0 req-2d77db6f-3d1e-4784-ac4d-336e16a3f9c5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030405 Jul 14 12:21:37.414836 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 253/495] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:37.447653 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-81176298-4648-486e-9c34-96578cb224ba tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:37.448258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-81176298-4648-486e-9c34-96578cb224ba tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:37.454154 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81176298-4648-486e-9c34-96578cb224ba tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.454600 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81176298-4648-486e-9c34-96578cb224ba tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.455387 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81176298-4648-486e-9c34-96578cb224ba tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.455813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81176298-4648-486e-9c34-96578cb224ba tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.489505 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5c0fb1e5-5d2c-4ed6-aa01-92f62fcd7844 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:37.490371 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5c0fb1e5-5d2c-4ed6-aa01-92f62fcd7844 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:37.497883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5c0fb1e5-5d2c-4ed6-aa01-92f62fcd7844 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.498447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5c0fb1e5-5d2c-4ed6-aa01-92f62fcd7844 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.499357 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5c0fb1e5-5d2c-4ed6-aa01-92f62fcd7844 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.499888 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5c0fb1e5-5d2c-4ed6-aa01-92f62fcd7844 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.600708 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-81176298-4648-486e-9c34-96578cb224ba tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:37.609081 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-81176298-4648-486e-9c34-96578cb224ba tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:37.610595 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-81176298-4648-486e-9c34-96578cb224ba tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:37.611774 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-81176298-4648-486e-9c34-96578cb224ba tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.168865 Jul 14 12:21:37.612344 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 243/496] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:37 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:37.638034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5c0fb1e5-5d2c-4ed6-aa01-92f62fcd7844 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:37.645457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5c0fb1e5-5d2c-4ed6-aa01-92f62fcd7844 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.160104 Jul 14 12:21:37.646025 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 254/497] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:37 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:37.950441 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:37.951746 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:37.959358 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.959813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.960760 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.962002 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.993718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:37.994168 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:37.994629 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lazy-loading 'fault' on Instance uuid 2aca3a55-17cb-461a-ad99-5606410ac540 {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:21:38.061458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:38.068911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-abcc2988-4f5e-43f8-88b2-f8fe415b983d tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1304 microversion: 2.1 time: 0.123473 Jul 14 12:21:38.069524 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 244/498] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:37 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1304 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:38.309315 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f111a967-51ec-4738-810e-ff89cdc0a2d8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:38.310082 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f111a967-51ec-4738-810e-ff89cdc0a2d8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:38.316565 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f111a967-51ec-4738-810e-ff89cdc0a2d8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:38.317015 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f111a967-51ec-4738-810e-ff89cdc0a2d8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:38.317848 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f111a967-51ec-4738-810e-ff89cdc0a2d8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:38.318287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f111a967-51ec-4738-810e-ff89cdc0a2d8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:38.404795 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bf70593e-3833-499a-8324-ceab2caa639d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:38.405409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-bf70593e-3833-499a-8324-ceab2caa639d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:38.411567 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf70593e-3833-499a-8324-ceab2caa639d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:38.412082 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf70593e-3833-499a-8324-ceab2caa639d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:38.412909 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf70593e-3833-499a-8324-ceab2caa639d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:38.413433 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf70593e-3833-499a-8324-ceab2caa639d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:38.454216 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f111a967-51ec-4738-810e-ff89cdc0a2d8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:38.462325 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f111a967-51ec-4738-810e-ff89cdc0a2d8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.157096 Jul 14 12:21:38.463180 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 255/499] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:38 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:38.571681 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-0cf3d9fb-74ee-4c04-8d5a-cf9964df8b44 req-3a134812-4f2a-402c-bce6-f7885a1345c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bec056f-1ed7-4c1f-9e79-6f44c353d9c3", "tag": "3eede203-2d63-46df-8338-538ec6d38092"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:38.582349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-0cf3d9fb-74ee-4c04-8d5a-cf9964df8b44 req-3a134812-4f2a-402c-bce6-f7885a1345c0 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:38.582930 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-0cf3d9fb-74ee-4c04-8d5a-cf9964df8b44 req-3a134812-4f2a-402c-bce6-f7885a1345c0 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:38.594789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-0cf3d9fb-74ee-4c04-8d5a-cf9964df8b44 req-3a134812-4f2a-402c-bce6-f7885a1345c0 service nova] Creating event network-changed:3eede203-2d63-46df-8338-538ec6d38092 for instance 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 on hv-cinder-84890 Jul 14 12:21:38.600541 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-0cf3d9fb-74ee-4c04-8d5a-cf9964df8b44 req-3a134812-4f2a-402c-bce6-f7885a1345c0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033525 Jul 14 12:21:38.601149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 256/500] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:38.631334 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-27584dca-2707-4876-8dfd-211313bd8b96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:38.632019 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-27584dca-2707-4876-8dfd-211313bd8b96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:38.639625 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-27584dca-2707-4876-8dfd-211313bd8b96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:38.640408 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-27584dca-2707-4876-8dfd-211313bd8b96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:38.641345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-27584dca-2707-4876-8dfd-211313bd8b96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:38.641775 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-27584dca-2707-4876-8dfd-211313bd8b96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:38.662005 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bf70593e-3833-499a-8324-ceab2caa639d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:38.669697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bf70593e-3833-499a-8324-ceab2caa639d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.268695 Jul 14 12:21:38.670267 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 245/501] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:38 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:38.674912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ddb7c56d-6890-465b-86cd-d618d935a04b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:38.675694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ddb7c56d-6890-465b-86cd-d618d935a04b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:38.681834 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ddb7c56d-6890-465b-86cd-d618d935a04b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:38.682408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ddb7c56d-6890-465b-86cd-d618d935a04b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:38.683210 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ddb7c56d-6890-465b-86cd-d618d935a04b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:38.683701 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ddb7c56d-6890-465b-86cd-d618d935a04b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:38.780336 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-27584dca-2707-4876-8dfd-211313bd8b96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:38.788330 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-27584dca-2707-4876-8dfd-211313bd8b96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:38.790453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-27584dca-2707-4876-8dfd-211313bd8b96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:38.791645 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-27584dca-2707-4876-8dfd-211313bd8b96 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.164662 Jul 14 12:21:38.792402 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 257/502] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:38 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:38.818993 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ddb7c56d-6890-465b-86cd-d618d935a04b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:38.826388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ddb7c56d-6890-465b-86cd-d618d935a04b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.155153 Jul 14 12:21:38.826978 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 246/503] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:38 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:39.087947 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:39.088675 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:39.103176 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.104604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.104604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.104844 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.137214 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.137610 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.138062 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lazy-loading 'fault' on Instance uuid 2aca3a55-17cb-461a-ad99-5606410ac540 {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:21:39.191448 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca8ddc2748da4b05bc6d7ee16ee3db24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '206723edeb144547882daa902124ed7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:39.199921 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-aab4bf52-d2d2-412e-b63f-c2ebb8d85a2f tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 200 len: 1304 microversion: 2.1 time: 0.116766 Jul 14 12:21:39.200500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 258/504] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:39 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:39.479441 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c3f5cc73-1d15-447d-87b1-80e835946329 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:39.480056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c3f5cc73-1d15-447d-87b1-80e835946329 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:39.486500 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3f5cc73-1d15-447d-87b1-80e835946329 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.486991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3f5cc73-1d15-447d-87b1-80e835946329 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.487747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3f5cc73-1d15-447d-87b1-80e835946329 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.488186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3f5cc73-1d15-447d-87b1-80e835946329 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.679756 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c3f5cc73-1d15-447d-87b1-80e835946329 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:39.687106 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-812ad4cd-710c-4915-8127-0eb1a6bf26b6 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:39.687966 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-812ad4cd-710c-4915-8127-0eb1a6bf26b6 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:39.691509 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c3f5cc73-1d15-447d-87b1-80e835946329 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.216475 Jul 14 12:21:39.695147 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-812ad4cd-710c-4915-8127-0eb1a6bf26b6 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.697743 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-812ad4cd-710c-4915-8127-0eb1a6bf26b6 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.697743 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-812ad4cd-710c-4915-8127-0eb1a6bf26b6 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.697743 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-812ad4cd-710c-4915-8127-0eb1a6bf26b6 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.702548 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 247/505] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:39 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:39.810238 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-910d7ff1-3fd4-453b-b35b-108331c3c9a7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:39.811064 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-910d7ff1-3fd4-453b-b35b-108331c3c9a7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:39.817985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-910d7ff1-3fd4-453b-b35b-108331c3c9a7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.818431 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-910d7ff1-3fd4-453b-b35b-108331c3c9a7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.819439 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-910d7ff1-3fd4-453b-b35b-108331c3c9a7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.820030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-910d7ff1-3fd4-453b-b35b-108331c3c9a7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.851951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-812ad4cd-710c-4915-8127-0eb1a6bf26b6 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:39.865125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-812ad4cd-710c-4915-8127-0eb1a6bf26b6 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.181720 Jul 14 12:21:39.866225 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 259/506] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:39 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:39.871839 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e2d43cdf-23a8-4d23-a958-73ccf07c74d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:39.873593 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e2d43cdf-23a8-4d23-a958-73ccf07c74d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:39.882757 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e2d43cdf-23a8-4d23-a958-73ccf07c74d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.883627 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e2d43cdf-23a8-4d23-a958-73ccf07c74d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.884418 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e2d43cdf-23a8-4d23-a958-73ccf07c74d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:39.884904 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e2d43cdf-23a8-4d23-a958-73ccf07c74d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:39.976623 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-910d7ff1-3fd4-453b-b35b-108331c3c9a7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:39.985500 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-910d7ff1-3fd4-453b-b35b-108331c3c9a7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:39.987191 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-910d7ff1-3fd4-453b-b35b-108331c3c9a7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:39.988402 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-910d7ff1-3fd4-453b-b35b-108331c3c9a7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.182566 Jul 14 12:21:39.988988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 248/507] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:39 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:21:40.029614 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e2d43cdf-23a8-4d23-a958-73ccf07c74d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:40.036923 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e2d43cdf-23a8-4d23-a958-73ccf07c74d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1370 microversion: 2.1 time: 0.169458 Jul 14 12:21:40.038907 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 260/508] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:39 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:40.217330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9711b0a3-0760-47d5-9867-225f2e9eb9fc tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:40.217961 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9711b0a3-0760-47d5-9867-225f2e9eb9fc tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] [instance: 2aca3a55-17cb-461a-ad99-5606410ac540] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:40.223971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9711b0a3-0760-47d5-9867-225f2e9eb9fc tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:40.224416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9711b0a3-0760-47d5-9867-225f2e9eb9fc tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:40.225175 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9711b0a3-0760-47d5-9867-225f2e9eb9fc tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:40.225602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9711b0a3-0760-47d5-9867-225f2e9eb9fc tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:40.238657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-9711b0a3-0760-47d5-9867-225f2e9eb9fc tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] HTTP exception thrown: Instance 2aca3a55-17cb-461a-ad99-5606410ac540 could not be found. Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9711b0a3-0760-47d5-9867-225f2e9eb9fc tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Request method failure captured: Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 HTTP/1.1 Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Aoqf750px_GQTyEycrUWz9qi2NgQw13LvQuhVJgxDPeYDqdpKnFtNk7AiSkvUjKpSlNbSi8jgZAcncQgKf9qEPKiZH1h76RLgJ8gHWES6m2Ge3iFRyKuQdKSLBc5NkSOruYEgX0_CnZ32MG91DIu86ckNgbUkMoC1lsSW9wpcpzv20 Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 206723edeb144547882daa902124ed7c Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-VolumesNegativeTest-260160711 Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:21:40.240298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_206723edeb144547882daa902124ed7c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/206723edeb144547882daa902124ed7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/206723edeb144547882daa902124ed7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/206723edeb144547882daa902124ed7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-VolumesNegativeTest-260160711 Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 206723edeb144547882daa902124ed7c Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-VolumesNegativeTest-260160711 Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-VolumesNegativeTest-260160711-project Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: ca8ddc2748da4b05bc6d7ee16ee3db24 Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-VolumesNegativeTest-260160711-project Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 2aca3a55-17cb-461a-ad99-5606410ac540 could not be found. Jul 14 12:21:40.241802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '2aca3a55-17cb-461a-ad99-5606410ac540'} Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aca3a55-17cb-461a-ad99-5606410ac540 could not be found. Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:21:40.243009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aca3a55-17cb-461a-ad99-5606410ac540 could not be found. Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aca3a55-17cb-461a-ad99-5606410ac540 could not be found. Jul 14 12:21:40.244489 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:21:40.246194 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9711b0a3-0760-47d5-9867-225f2e9eb9fc tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] Returning 404 to user: Instance 2aca3a55-17cb-461a-ad99-5606410ac540 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:21:40.246194 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9711b0a3-0760-47d5-9867-225f2e9eb9fc tempest-VolumesNegativeTest-260160711 tempest-VolumesNegativeTest-260160711-project] 10.222.0.27 "GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540" status: 404 len: 111 microversion: 2.1 time: 0.028293 Jul 14 12:21:40.246194 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 249/509] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:40 2022] GET /compute/v2.1/servers/2aca3a55-17cb-461a-ad99-5606410ac540 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:21:40.708603 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-86f1753c-c172-4c8e-a962-ce2acedc7d63 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:40.719423 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-86f1753c-c172-4c8e-a962-ce2acedc7d63 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:40.732804 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-86f1753c-c172-4c8e-a962-ce2acedc7d63 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:40.733877 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-86f1753c-c172-4c8e-a962-ce2acedc7d63 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:40.735003 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-86f1753c-c172-4c8e-a962-ce2acedc7d63 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:40.735230 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-86f1753c-c172-4c8e-a962-ce2acedc7d63 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:40.873147 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-86f1753c-c172-4c8e-a962-ce2acedc7d63 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:40.880882 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-86f1753c-c172-4c8e-a962-ce2acedc7d63 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.176071 Jul 14 12:21:40.881843 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-83a3d869-094b-47ef-b2aa-e9ab0aa9fdb2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:40.883174 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-83a3d869-094b-47ef-b2aa-e9ab0aa9fdb2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:40.887966 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 261/510] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:40 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:40.894808 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-83a3d869-094b-47ef-b2aa-e9ab0aa9fdb2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:40.895483 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-83a3d869-094b-47ef-b2aa-e9ab0aa9fdb2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:40.896444 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-83a3d869-094b-47ef-b2aa-e9ab0aa9fdb2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:40.896917 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-83a3d869-094b-47ef-b2aa-e9ab0aa9fdb2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:41.008027 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b8c0be66-c5f5-4ef5-8c61-31351310f809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:41.008631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b8c0be66-c5f5-4ef5-8c61-31351310f809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:41.015477 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b8c0be66-c5f5-4ef5-8c61-31351310f809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:41.016494 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b8c0be66-c5f5-4ef5-8c61-31351310f809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:41.017446 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b8c0be66-c5f5-4ef5-8c61-31351310f809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:41.018095 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b8c0be66-c5f5-4ef5-8c61-31351310f809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:41.023233 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:41.187830 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b8c0be66-c5f5-4ef5-8c61-31351310f809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:41.198645 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b8c0be66-c5f5-4ef5-8c61-31351310f809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:41.200778 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b8c0be66-c5f5-4ef5-8c61-31351310f809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:41.203603 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b8c0be66-c5f5-4ef5-8c61-31351310f809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.200624 Jul 14 12:21:41.204921 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 262/511] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:41 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:21:41.216290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-12463e71-9f7c-49b1-ac5e-0799694082e5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:41.217376 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-12463e71-9f7c-49b1-ac5e-0799694082e5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:41.226137 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-12463e71-9f7c-49b1-ac5e-0799694082e5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:41.226993 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-12463e71-9f7c-49b1-ac5e-0799694082e5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:41.228497 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-12463e71-9f7c-49b1-ac5e-0799694082e5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:41.229148 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-12463e71-9f7c-49b1-ac5e-0799694082e5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:41.329406 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-83a3d869-094b-47ef-b2aa-e9ab0aa9fdb2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:41.341104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-83a3d869-094b-47ef-b2aa-e9ab0aa9fdb2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.463216 Jul 14 12:21:41.341676 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 250/512] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:40 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:41.361350 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-0aa53c27-612a-4215-bb8d-4dea499cec0e req-ec742db2-22f8-4a61-aa84-d80fe452a414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357e6fda-615e-4e1a-9f33-552398705e3e", "name": "network-vif-plugged", "status": "completed", "tag": "8d1d4c31-5832-429c-8506-0433ac2a974b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:41.370206 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-0aa53c27-612a-4215-bb8d-4dea499cec0e req-ec742db2-22f8-4a61-aa84-d80fe452a414 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:41.371204 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-0aa53c27-612a-4215-bb8d-4dea499cec0e req-ec742db2-22f8-4a61-aa84-d80fe452a414 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:41.382185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-0aa53c27-612a-4215-bb8d-4dea499cec0e req-ec742db2-22f8-4a61-aa84-d80fe452a414 service nova] Creating event network-vif-plugged:8d1d4c31-5832-429c-8506-0433ac2a974b for instance 357e6fda-615e-4e1a-9f33-552398705e3e on hv-cinder-84890 Jul 14 12:21:41.387983 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-0aa53c27-612a-4215-bb8d-4dea499cec0e req-ec742db2-22f8-4a61-aa84-d80fe452a414 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031279 Jul 14 12:21:41.388875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 251/513] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:41.423056 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-12463e71-9f7c-49b1-ac5e-0799694082e5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:41.431241 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-12463e71-9f7c-49b1-ac5e-0799694082e5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1564 microversion: 2.1 time: 0.225120 Jul 14 12:21:41.432044 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 263/514] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:41 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1564 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:41.444393 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:41.445507 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=6 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:41.450176 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a16f31ac-7120-4d1e-92ab-f4e89beb952a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:41.450747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a16f31ac-7120-4d1e-92ab-f4e89beb952a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:41.457637 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a16f31ac-7120-4d1e-92ab-f4e89beb952a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:41.458315 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a16f31ac-7120-4d1e-92ab-f4e89beb952a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:41.459316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a16f31ac-7120-4d1e-92ab-f4e89beb952a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:41.459750 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a16f31ac-7120-4d1e-92ab-f4e89beb952a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:41.547819 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a16f31ac-7120-4d1e-92ab-f4e89beb952a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103863 Jul 14 12:21:41.548435 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 252/515] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 12:21:41 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:41.905752 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8e9061a4-27cc-4df4-b4ff-a1ff208243bd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:41.907195 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8e9061a4-27cc-4df4-b4ff-a1ff208243bd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:41.909099 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:41.915211 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8e9061a4-27cc-4df4-b4ff-a1ff208243bd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:41.920465 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8e9061a4-27cc-4df4-b4ff-a1ff208243bd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:41.920465 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8e9061a4-27cc-4df4-b4ff-a1ff208243bd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:41.920465 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8e9061a4-27cc-4df4-b4ff-a1ff208243bd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:42.051443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8e9061a4-27cc-4df4-b4ff-a1ff208243bd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:42.059307 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8e9061a4-27cc-4df4-b4ff-a1ff208243bd tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.157378 Jul 14 12:21:42.063506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 264/516] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:41 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:42.222437 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d18793a6-a080-49d0-8144-b592c254afbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:42.223348 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d18793a6-a080-49d0-8144-b592c254afbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:42.230992 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d18793a6-a080-49d0-8144-b592c254afbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:42.231759 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d18793a6-a080-49d0-8144-b592c254afbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:42.232739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d18793a6-a080-49d0-8144-b592c254afbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:42.233179 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d18793a6-a080-49d0-8144-b592c254afbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:42.358729 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-34aab9f3-e9b0-4a37-9062-73aa99f08a38 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:42.359549 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-34aab9f3-e9b0-4a37-9062-73aa99f08a38 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:42.368432 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34aab9f3-e9b0-4a37-9062-73aa99f08a38 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:42.369180 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34aab9f3-e9b0-4a37-9062-73aa99f08a38 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:42.369987 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34aab9f3-e9b0-4a37-9062-73aa99f08a38 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:42.370977 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34aab9f3-e9b0-4a37-9062-73aa99f08a38 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:42.490442 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d18793a6-a080-49d0-8144-b592c254afbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:42.500526 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d18793a6-a080-49d0-8144-b592c254afbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:42.502256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d18793a6-a080-49d0-8144-b592c254afbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:42.503843 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d18793a6-a080-49d0-8144-b592c254afbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.286283 Jul 14 12:21:42.504749 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 253/517] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:42 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:42.514947 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-34aab9f3-e9b0-4a37-9062-73aa99f08a38 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:42.523268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-34aab9f3-e9b0-4a37-9062-73aa99f08a38 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.169533 Jul 14 12:21:42.525644 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 265/518] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:42 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:42.667952 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-125ff137-2ec2-4360-aa12-f3a3707165db req-1560cca9-f53f-4c16-917a-bcaa165b9ca9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158005c6-a074-4abf-a8b8-7c1ee3250b2e", "tag": "ea14a717-a283-4fb9-92a3-043257ce7e6e"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:42.676772 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-125ff137-2ec2-4360-aa12-f3a3707165db req-1560cca9-f53f-4c16-917a-bcaa165b9ca9 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:42.677217 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-125ff137-2ec2-4360-aa12-f3a3707165db req-1560cca9-f53f-4c16-917a-bcaa165b9ca9 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:42.688914 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-125ff137-2ec2-4360-aa12-f3a3707165db req-1560cca9-f53f-4c16-917a-bcaa165b9ca9 service nova] Creating event network-changed:ea14a717-a283-4fb9-92a3-043257ce7e6e for instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e on hv-cinder-84890 Jul 14 12:21:42.693672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-125ff137-2ec2-4360-aa12-f3a3707165db req-1560cca9-f53f-4c16-917a-bcaa165b9ca9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030256 Jul 14 12:21:42.694261 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 254/519] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:21:43.077973 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-45ac350e-0efa-42a6-9a44-93caf390334e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:43.078993 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-45ac350e-0efa-42a6-9a44-93caf390334e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:43.088497 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45ac350e-0efa-42a6-9a44-93caf390334e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:43.089213 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45ac350e-0efa-42a6-9a44-93caf390334e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:43.090726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45ac350e-0efa-42a6-9a44-93caf390334e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:43.091412 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45ac350e-0efa-42a6-9a44-93caf390334e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:43.245602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-45ac350e-0efa-42a6-9a44-93caf390334e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:43.253374 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-45ac350e-0efa-42a6-9a44-93caf390334e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.180105 Jul 14 12:21:43.253938 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 266/520] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:43 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:43.523160 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-03b8a27d-517f-4cff-9625-f5d61d98f88f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:43.524865 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-03b8a27d-517f-4cff-9625-f5d61d98f88f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:43.527940 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:43.531703 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03b8a27d-517f-4cff-9625-f5d61d98f88f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:43.532154 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03b8a27d-517f-4cff-9625-f5d61d98f88f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:43.532936 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03b8a27d-517f-4cff-9625-f5d61d98f88f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:43.533370 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03b8a27d-517f-4cff-9625-f5d61d98f88f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:43.541405 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8904afa9-ce6f-4f0e-9a5c-c67ec9c858cf tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:43.542232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8904afa9-ce6f-4f0e-9a5c-c67ec9c858cf tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:43.553935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8904afa9-ce6f-4f0e-9a5c-c67ec9c858cf tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:43.565415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8904afa9-ce6f-4f0e-9a5c-c67ec9c858cf tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:43.565415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8904afa9-ce6f-4f0e-9a5c-c67ec9c858cf tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:43.565415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8904afa9-ce6f-4f0e-9a5c-c67ec9c858cf tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:43.704314 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8904afa9-ce6f-4f0e-9a5c-c67ec9c858cf tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:43.716004 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8904afa9-ce6f-4f0e-9a5c-c67ec9c858cf tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.179378 Jul 14 12:21:43.726438 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 267/521] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:43 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:43.735705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-754e48eb-7d98-4034-acbc-fbbe68227311 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:43.736694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-754e48eb-7d98-4034-acbc-fbbe68227311 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:43.745054 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-754e48eb-7d98-4034-acbc-fbbe68227311 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:43.745495 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-754e48eb-7d98-4034-acbc-fbbe68227311 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:43.746319 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-754e48eb-7d98-4034-acbc-fbbe68227311 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:43.746964 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-754e48eb-7d98-4034-acbc-fbbe68227311 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:43.765608 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-03b8a27d-517f-4cff-9625-f5d61d98f88f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:43.775838 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-03b8a27d-517f-4cff-9625-f5d61d98f88f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:43.777759 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-03b8a27d-517f-4cff-9625-f5d61d98f88f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:43.779219 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-03b8a27d-517f-4cff-9625-f5d61d98f88f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.260722 Jul 14 12:21:43.787261 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 255/522] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:43 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:43.906156 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-754e48eb-7d98-4034-acbc-fbbe68227311 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lazy-loading 'services' on Instance uuid d2634876-d37b-4436-9c61-23c72f9be7f0 {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:21:44.218006 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-754e48eb-7d98-4034-acbc-fbbe68227311 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/os-volume_attachments/1bc12649-a0b5-493d-8aac-e16687ab09a8" status: 202 len: 0 microversion: 2.1 time: 0.489160 Jul 14 12:21:44.219541 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 268/523] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:21:43 2022] DELETE /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/os-volume_attachments/1bc12649-a0b5-493d-8aac-e16687ab09a8 => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:21:44.272223 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2a2f6598-d0a9-4b9c-bbbf-8058b51bdddc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:44.272826 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2a2f6598-d0a9-4b9c-bbbf-8058b51bdddc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:44.279446 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2a2f6598-d0a9-4b9c-bbbf-8058b51bdddc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:44.279898 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2a2f6598-d0a9-4b9c-bbbf-8058b51bdddc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:44.280668 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2a2f6598-d0a9-4b9c-bbbf-8058b51bdddc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:44.281106 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2a2f6598-d0a9-4b9c-bbbf-8058b51bdddc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:44.300555 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:44.416517 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2a2f6598-d0a9-4b9c-bbbf-8058b51bdddc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:44.424310 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2a2f6598-d0a9-4b9c-bbbf-8058b51bdddc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1358 microversion: 2.1 time: 0.156878 Jul 14 12:21:44.424812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 256/524] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:44 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:44.734319 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b6cf7a52-4530-4f32-9a05-61d56092241c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:44.737123 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b6cf7a52-4530-4f32-9a05-61d56092241c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:44.741970 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b6cf7a52-4530-4f32-9a05-61d56092241c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:44.743103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b6cf7a52-4530-4f32-9a05-61d56092241c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:44.743864 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b6cf7a52-4530-4f32-9a05-61d56092241c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:44.744293 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b6cf7a52-4530-4f32-9a05-61d56092241c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:44.799146 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-415d6f99-d196-483e-beed-b6b50c7b0226 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:44.799900 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-415d6f99-d196-483e-beed-b6b50c7b0226 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:44.807971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-415d6f99-d196-483e-beed-b6b50c7b0226 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:44.808451 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-415d6f99-d196-483e-beed-b6b50c7b0226 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:44.809368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-415d6f99-d196-483e-beed-b6b50c7b0226 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:44.809840 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-415d6f99-d196-483e-beed-b6b50c7b0226 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:44.879723 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b6cf7a52-4530-4f32-9a05-61d56092241c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:44.887556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b6cf7a52-4530-4f32-9a05-61d56092241c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.157459 Jul 14 12:21:44.888142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 269/525] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:44 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:44.945121 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-415d6f99-d196-483e-beed-b6b50c7b0226 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:44.953087 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-415d6f99-d196-483e-beed-b6b50c7b0226 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:44.954593 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-415d6f99-d196-483e-beed-b6b50c7b0226 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:44.955770 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-415d6f99-d196-483e-beed-b6b50c7b0226 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.161083 Jul 14 12:21:44.956320 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 257/526] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:44 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:21:45.441643 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f0917657-572c-4bec-b563-da4d6975c4d6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:45.442253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f0917657-572c-4bec-b563-da4d6975c4d6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:45.449373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0917657-572c-4bec-b563-da4d6975c4d6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:45.449826 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0917657-572c-4bec-b563-da4d6975c4d6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:45.450593 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0917657-572c-4bec-b563-da4d6975c4d6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:45.451063 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0917657-572c-4bec-b563-da4d6975c4d6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:45.580940 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f0917657-572c-4bec-b563-da4d6975c4d6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:45.588900 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f0917657-572c-4bec-b563-da4d6975c4d6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1547 microversion: 2.1 time: 0.151118 Jul 14 12:21:45.589472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 270/527] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:45 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:45.612102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-da05ba04-866d-4387-8661-178f9c168b3f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:45.612742 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-da05ba04-866d-4387-8661-178f9c168b3f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:45.619099 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da05ba04-866d-4387-8661-178f9c168b3f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:45.619547 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da05ba04-866d-4387-8661-178f9c168b3f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:45.620497 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da05ba04-866d-4387-8661-178f9c168b3f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:45.623431 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da05ba04-866d-4387-8661-178f9c168b3f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:45.749238 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-da05ba04-866d-4387-8661-178f9c168b3f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:45.756850 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-da05ba04-866d-4387-8661-178f9c168b3f tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1547 microversion: 2.1 time: 0.148673 Jul 14 12:21:45.757416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 258/528] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:45 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:45.772986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d7ddd871-ab5b-42c8-9b43-202e53aa2d9a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:45.776467 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d7ddd871-ab5b-42c8-9b43-202e53aa2d9a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:45.777220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d7ddd871-ab5b-42c8-9b43-202e53aa2d9a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Searching by: {'deleted': False, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c'} {{(pid=118262) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 12:21:45.783895 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d7ddd871-ab5b-42c8-9b43-202e53aa2d9a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:45.784386 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d7ddd871-ab5b-42c8-9b43-202e53aa2d9a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:45.785175 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d7ddd871-ab5b-42c8-9b43-202e53aa2d9a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:45.785609 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d7ddd871-ab5b-42c8-9b43-202e53aa2d9a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:45.876203 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.multi_cell_list [None req-d7ddd871-ab5b-42c8-9b43-202e53aa2d9a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118262) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 12:21:45.906046 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7cae7088-bf44-4cfa-bbac-93eef6aee445 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:45.906744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7cae7088-bf44-4cfa-bbac-93eef6aee445 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:45.913572 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7cae7088-bf44-4cfa-bbac-93eef6aee445 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:45.914366 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7cae7088-bf44-4cfa-bbac-93eef6aee445 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:45.921458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7cae7088-bf44-4cfa-bbac-93eef6aee445 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:45.921458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7cae7088-bf44-4cfa-bbac-93eef6aee445 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:45.982382 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d7ddd871-ab5b-42c8-9b43-202e53aa2d9a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213012 Jul 14 12:21:45.982985 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 271/529] 10.222.0.27 () {58 vars in 1124 bytes} [Thu Jul 14 12:21:45 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:45.991560 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c3d1a776-92d9-4964-9a08-e8ddfdb6a039 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:45.992726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c3d1a776-92d9-4964-9a08-e8ddfdb6a039 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:46.000983 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3d1a776-92d9-4964-9a08-e8ddfdb6a039 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:46.001434 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3d1a776-92d9-4964-9a08-e8ddfdb6a039 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:46.002213 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3d1a776-92d9-4964-9a08-e8ddfdb6a039 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:46.002668 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3d1a776-92d9-4964-9a08-e8ddfdb6a039 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:46.090928 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7cae7088-bf44-4cfa-bbac-93eef6aee445 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:46.099060 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7cae7088-bf44-4cfa-bbac-93eef6aee445 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.197448 Jul 14 12:21:46.108978 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 259/530] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:45 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:46.108978 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-824ed9d6-5b26-4216-946a-86fd650c6c28 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:46.108978 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-824ed9d6-5b26-4216-946a-86fd650c6c28 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:46.114056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-824ed9d6-5b26-4216-946a-86fd650c6c28 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:46.114788 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-824ed9d6-5b26-4216-946a-86fd650c6c28 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:46.115783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-824ed9d6-5b26-4216-946a-86fd650c6c28 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:46.116212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-824ed9d6-5b26-4216-946a-86fd650c6c28 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:46.157960 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c3d1a776-92d9-4964-9a08-e8ddfdb6a039 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:46.166731 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c3d1a776-92d9-4964-9a08-e8ddfdb6a039 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:46.168256 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c3d1a776-92d9-4964-9a08-e8ddfdb6a039 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:46.169572 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c3d1a776-92d9-4964-9a08-e8ddfdb6a039 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.181951 Jul 14 12:21:46.170134 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 272/531] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:45 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:46.253433 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-824ed9d6-5b26-4216-946a-86fd650c6c28 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:46.261142 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-824ed9d6-5b26-4216-946a-86fd650c6c28 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1547 microversion: 2.1 time: 0.159751 Jul 14 12:21:46.261711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 260/532] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:46 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1547 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:46.655481 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8db06540-86b4-4522-9e34-8f76d31624f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:46.662039 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8db06540-86b4-4522-9e34-8f76d31624f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:46.662491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8db06540-86b4-4522-9e34-8f76d31624f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:46.686664 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8db06540-86b4-4522-9e34-8f76d31624f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Going to try to stop instance {{(pid=118262) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 12:21:46.878470 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8db06540-86b4-4522-9e34-8f76d31624f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/action" status: 202 len: 0 microversion: 2.1 time: 0.226681 Jul 14 12:21:46.879292 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 273/533] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:21:46 2022] POST /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:21:46.889424 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-fd19f26f-9f93-4080-8821-da003005811b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:46.890037 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-fd19f26f-9f93-4080-8821-da003005811b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:46.906465 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fd19f26f-9f93-4080-8821-da003005811b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:46.908506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fd19f26f-9f93-4080-8821-da003005811b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:46.909458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fd19f26f-9f93-4080-8821-da003005811b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:46.910072 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fd19f26f-9f93-4080-8821-da003005811b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:47.068906 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-fd19f26f-9f93-4080-8821-da003005811b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:47.078431 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-fd19f26f-9f93-4080-8821-da003005811b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1674 microversion: 2.1 time: 0.192945 Jul 14 12:21:47.079312 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 261/534] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:46 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1674 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:47.119386 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2764bdc9-3def-491b-bdb2-fc6c1ed7dd56 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:47.120583 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2764bdc9-3def-491b-bdb2-fc6c1ed7dd56 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:47.123015 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=100 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:47.130388 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2764bdc9-3def-491b-bdb2-fc6c1ed7dd56 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:47.130856 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2764bdc9-3def-491b-bdb2-fc6c1ed7dd56 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:47.131813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2764bdc9-3def-491b-bdb2-fc6c1ed7dd56 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:47.132530 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2764bdc9-3def-491b-bdb2-fc6c1ed7dd56 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:47.189253 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-40456028-c019-4426-895d-6dcd89284b8a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:47.189862 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-40456028-c019-4426-895d-6dcd89284b8a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:47.196757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-40456028-c019-4426-895d-6dcd89284b8a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:47.197429 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-40456028-c019-4426-895d-6dcd89284b8a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:47.198260 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-40456028-c019-4426-895d-6dcd89284b8a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:47.198822 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-40456028-c019-4426-895d-6dcd89284b8a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:47.278340 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2764bdc9-3def-491b-bdb2-fc6c1ed7dd56 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:47.286658 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2764bdc9-3def-491b-bdb2-fc6c1ed7dd56 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.173878 Jul 14 12:21:47.287455 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 274/535] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:47 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:47.345674 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-40456028-c019-4426-895d-6dcd89284b8a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:47.349582 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-1e4bccb2-1d6d-4c8a-82ce-3643a2e80957 req-2a32eddd-1e65-4631-8fa3-68a219f9b119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bec056f-1ed7-4c1f-9e79-6f44c353d9c3", "name": "network-vif-plugged", "status": "completed", "tag": "3eede203-2d63-46df-8338-538ec6d38092"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:47.354845 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-40456028-c019-4426-895d-6dcd89284b8a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:47.356472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-40456028-c019-4426-895d-6dcd89284b8a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:47.357690 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-40456028-c019-4426-895d-6dcd89284b8a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.172493 Jul 14 12:21:47.357807 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-1e4bccb2-1d6d-4c8a-82ce-3643a2e80957 req-2a32eddd-1e65-4631-8fa3-68a219f9b119 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:47.358853 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-1e4bccb2-1d6d-4c8a-82ce-3643a2e80957 req-2a32eddd-1e65-4631-8fa3-68a219f9b119 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:47.361832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 262/536] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:47 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:21:47.369771 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-1e4bccb2-1d6d-4c8a-82ce-3643a2e80957 req-2a32eddd-1e65-4631-8fa3-68a219f9b119 service nova] Creating event network-vif-plugged:3eede203-2d63-46df-8338-538ec6d38092 for instance 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 on hv-cinder-84890 Jul 14 12:21:47.374417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-1e4bccb2-1d6d-4c8a-82ce-3643a2e80957 req-2a32eddd-1e65-4631-8fa3-68a219f9b119 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029633 Jul 14 12:21:47.375034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 275/537] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:21:48.097315 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-81359e3b-45d8-4840-93bc-327c4dbfb2f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:48.097929 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-81359e3b-45d8-4840-93bc-327c4dbfb2f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:48.105191 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81359e3b-45d8-4840-93bc-327c4dbfb2f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:48.105686 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81359e3b-45d8-4840-93bc-327c4dbfb2f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:48.106486 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81359e3b-45d8-4840-93bc-327c4dbfb2f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:48.106911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81359e3b-45d8-4840-93bc-327c4dbfb2f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:48.165160 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-39dca575-5c42-4704-8bee-9060bfa30e00 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc365573-26bb-4d0e-a240-59272046a3d1"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:48.166295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-39dca575-5c42-4704-8bee-9060bfa30e00 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:48.172732 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-39dca575-5c42-4704-8bee-9060bfa30e00 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:48.173180 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-39dca575-5c42-4704-8bee-9060bfa30e00 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:48.173940 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-39dca575-5c42-4704-8bee-9060bfa30e00 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:48.174374 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-39dca575-5c42-4704-8bee-9060bfa30e00 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:48.236326 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-81359e3b-45d8-4840-93bc-327c4dbfb2f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:48.244200 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-81359e3b-45d8-4840-93bc-327c4dbfb2f9 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1674 microversion: 2.1 time: 0.150614 Jul 14 12:21:48.244672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 263/538] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:48 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:48.303987 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4bc13b44-2379-4d68-82f4-e4713e202cde tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:48.304782 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4bc13b44-2379-4d68-82f4-e4713e202cde tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:48.310891 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4bc13b44-2379-4d68-82f4-e4713e202cde tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:48.311345 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4bc13b44-2379-4d68-82f4-e4713e202cde tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:48.312154 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4bc13b44-2379-4d68-82f4-e4713e202cde tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:48.312600 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4bc13b44-2379-4d68-82f4-e4713e202cde tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:48.444559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4bc13b44-2379-4d68-82f4-e4713e202cde tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:48.452541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4bc13b44-2379-4d68-82f4-e4713e202cde tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.152618 Jul 14 12:21:48.453117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 264/539] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:48 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:48.457565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a08e8194-b80f-4f81-aee0-e43bfbddb787 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:48.458186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a08e8194-b80f-4f81-aee0-e43bfbddb787 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:48.464717 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a08e8194-b80f-4f81-aee0-e43bfbddb787 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:48.465171 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a08e8194-b80f-4f81-aee0-e43bfbddb787 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:48.465935 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a08e8194-b80f-4f81-aee0-e43bfbddb787 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:48.466374 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a08e8194-b80f-4f81-aee0-e43bfbddb787 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:48.592903 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a08e8194-b80f-4f81-aee0-e43bfbddb787 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:48.601009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a08e8194-b80f-4f81-aee0-e43bfbddb787 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:48.605453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a08e8194-b80f-4f81-aee0-e43bfbddb787 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:48.605453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a08e8194-b80f-4f81-aee0-e43bfbddb787 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.149841 Jul 14 12:21:48.605453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 265/540] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:48 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:49.112324 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:49.248842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-39dca575-5c42-4704-8bee-9060bfa30e00 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "POST /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.089035 Jul 14 12:21:49.249509 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 276/541] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:21:48 2022] POST /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments => generated 194 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:21:49.261696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f7f632c7-c0a1-406b-86b0-0c3a2ab18464 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:49.262316 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f7f632c7-c0a1-406b-86b0-0c3a2ab18464 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:49.268723 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f7f632c7-c0a1-406b-86b0-0c3a2ab18464 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:49.269182 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f7f632c7-c0a1-406b-86b0-0c3a2ab18464 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:49.269952 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f7f632c7-c0a1-406b-86b0-0c3a2ab18464 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:49.270394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f7f632c7-c0a1-406b-86b0-0c3a2ab18464 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:49.401947 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f7f632c7-c0a1-406b-86b0-0c3a2ab18464 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:49.409338 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f7f632c7-c0a1-406b-86b0-0c3a2ab18464 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1674 microversion: 2.1 time: 0.151854 Jul 14 12:21:49.409905 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 266/542] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:49 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:49.470146 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-34911f5c-b063-4059-b503-5df29f9ff533 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:49.470851 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-34911f5c-b063-4059-b503-5df29f9ff533 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:49.478394 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34911f5c-b063-4059-b503-5df29f9ff533 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:49.478867 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34911f5c-b063-4059-b503-5df29f9ff533 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:49.479632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34911f5c-b063-4059-b503-5df29f9ff533 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:49.480063 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34911f5c-b063-4059-b503-5df29f9ff533 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:49.612729 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-34911f5c-b063-4059-b503-5df29f9ff533 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:49.620589 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-34911f5c-b063-4059-b503-5df29f9ff533 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1318 microversion: 2.1 time: 0.154974 Jul 14 12:21:49.621162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 277/543] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:49 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:49.622986 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5d13f675-8fbf-45ca-ab52-da65c6c0efa2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:49.623523 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5d13f675-8fbf-45ca-ab52-da65c6c0efa2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:49.629918 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5d13f675-8fbf-45ca-ab52-da65c6c0efa2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:49.630359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5d13f675-8fbf-45ca-ab52-da65c6c0efa2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:49.631166 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5d13f675-8fbf-45ca-ab52-da65c6c0efa2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:49.631606 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5d13f675-8fbf-45ca-ab52-da65c6c0efa2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:49.764867 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5d13f675-8fbf-45ca-ab52-da65c6c0efa2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:49.774026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5d13f675-8fbf-45ca-ab52-da65c6c0efa2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:49.782591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5d13f675-8fbf-45ca-ab52-da65c6c0efa2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:49.782591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5d13f675-8fbf-45ca-ab52-da65c6c0efa2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.158072 Jul 14 12:21:49.785176 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 267/544] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:49 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:21:50.427180 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cbbc37ed-fca3-4ab2-aa68-8311062230e2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:50.427790 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-cbbc37ed-fca3-4ab2-aa68-8311062230e2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:50.434377 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cbbc37ed-fca3-4ab2-aa68-8311062230e2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:50.434859 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cbbc37ed-fca3-4ab2-aa68-8311062230e2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:50.435632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cbbc37ed-fca3-4ab2-aa68-8311062230e2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:50.436108 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cbbc37ed-fca3-4ab2-aa68-8311062230e2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:50.563267 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-cbbc37ed-fca3-4ab2-aa68-8311062230e2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:50.571423 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cbbc37ed-fca3-4ab2-aa68-8311062230e2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1674 microversion: 2.1 time: 0.148009 Jul 14 12:21:50.571986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 278/545] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:50 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:50.637723 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-81c97bc2-bc3c-485a-8dab-f1709402946d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:50.638382 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-81c97bc2-bc3c-485a-8dab-f1709402946d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:50.644835 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81c97bc2-bc3c-485a-8dab-f1709402946d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:50.645274 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81c97bc2-bc3c-485a-8dab-f1709402946d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:50.646026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81c97bc2-bc3c-485a-8dab-f1709402946d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:50.646452 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81c97bc2-bc3c-485a-8dab-f1709402946d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:50.780359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-81c97bc2-bc3c-485a-8dab-f1709402946d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:50.787969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-81c97bc2-bc3c-485a-8dab-f1709402946d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1506 microversion: 2.1 time: 0.154070 Jul 14 12:21:50.788636 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 268/546] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:50 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:50.794955 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-91976cba-4aaa-4317-af47-d142179e7630 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:50.795568 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-91976cba-4aaa-4317-af47-d142179e7630 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:50.808801 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-91976cba-4aaa-4317-af47-d142179e7630 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:50.809257 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-91976cba-4aaa-4317-af47-d142179e7630 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:50.810048 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-91976cba-4aaa-4317-af47-d142179e7630 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:50.810473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-91976cba-4aaa-4317-af47-d142179e7630 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:50.952235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-91976cba-4aaa-4317-af47-d142179e7630 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:50.960218 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-91976cba-4aaa-4317-af47-d142179e7630 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:50.962258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-91976cba-4aaa-4317-af47-d142179e7630 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:50.963422 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-91976cba-4aaa-4317-af47-d142179e7630 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.172462 Jul 14 12:21:50.967830 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 279/547] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:50 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:51.587910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0b202608-8d23-464a-bf49-c9ef1b413580 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:51.588515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0b202608-8d23-464a-bf49-c9ef1b413580 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:51.594587 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0b202608-8d23-464a-bf49-c9ef1b413580 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:51.595059 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0b202608-8d23-464a-bf49-c9ef1b413580 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:51.595806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0b202608-8d23-464a-bf49-c9ef1b413580 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:51.596235 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0b202608-8d23-464a-bf49-c9ef1b413580 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:51.724773 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0b202608-8d23-464a-bf49-c9ef1b413580 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:51.734251 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0b202608-8d23-464a-bf49-c9ef1b413580 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1674 microversion: 2.1 time: 0.150189 Jul 14 12:21:51.734842 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 269/548] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:51 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:51.981949 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-96f1c7d7-bde8-4235-a98e-6a9b8185b151 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:51.982548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-96f1c7d7-bde8-4235-a98e-6a9b8185b151 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:51.989177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-96f1c7d7-bde8-4235-a98e-6a9b8185b151 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:51.989621 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-96f1c7d7-bde8-4235-a98e-6a9b8185b151 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:51.990378 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-96f1c7d7-bde8-4235-a98e-6a9b8185b151 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:51.990842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-96f1c7d7-bde8-4235-a98e-6a9b8185b151 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:52.124300 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-96f1c7d7-bde8-4235-a98e-6a9b8185b151 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:52.132605 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-96f1c7d7-bde8-4235-a98e-6a9b8185b151 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:52.134113 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-96f1c7d7-bde8-4235-a98e-6a9b8185b151 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:52.135294 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-96f1c7d7-bde8-4235-a98e-6a9b8185b151 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1742 microversion: 2.20 time: 0.157232 Jul 14 12:21:52.135891 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 280/549] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:51 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1742 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:52.751633 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-979c4e96-53e6-4a1b-9498-0283c480eede tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:52.752237 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-979c4e96-53e6-4a1b-9498-0283c480eede tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:52.759627 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-979c4e96-53e6-4a1b-9498-0283c480eede tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:52.760079 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-979c4e96-53e6-4a1b-9498-0283c480eede tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:52.760827 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-979c4e96-53e6-4a1b-9498-0283c480eede tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:52.761254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-979c4e96-53e6-4a1b-9498-0283c480eede tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:52.893197 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-979c4e96-53e6-4a1b-9498-0283c480eede tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:52.900656 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-979c4e96-53e6-4a1b-9498-0283c480eede tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1674 microversion: 2.1 time: 0.153017 Jul 14 12:21:52.901223 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 270/550] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:52 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:53.154064 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ef1e2b83-085e-4605-9654-2ca8ad31f9de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:53.154738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ef1e2b83-085e-4605-9654-2ca8ad31f9de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:53.161551 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ef1e2b83-085e-4605-9654-2ca8ad31f9de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:53.162029 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ef1e2b83-085e-4605-9654-2ca8ad31f9de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:53.162894 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ef1e2b83-085e-4605-9654-2ca8ad31f9de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:53.163852 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ef1e2b83-085e-4605-9654-2ca8ad31f9de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:53.299350 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ef1e2b83-085e-4605-9654-2ca8ad31f9de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:53.307532 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ef1e2b83-085e-4605-9654-2ca8ad31f9de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:53.309064 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ef1e2b83-085e-4605-9654-2ca8ad31f9de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:53.310487 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ef1e2b83-085e-4605-9654-2ca8ad31f9de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1742 microversion: 2.20 time: 0.160602 Jul 14 12:21:53.311088 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 281/551] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:53 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:53.922597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3b9104cd-0ca9-4406-aa17-27283451fd07 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:53.922597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3b9104cd-0ca9-4406-aa17-27283451fd07 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:53.925731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3b9104cd-0ca9-4406-aa17-27283451fd07 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:53.926268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3b9104cd-0ca9-4406-aa17-27283451fd07 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:53.929635 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3b9104cd-0ca9-4406-aa17-27283451fd07 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:53.929635 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3b9104cd-0ca9-4406-aa17-27283451fd07 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:54.061278 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3b9104cd-0ca9-4406-aa17-27283451fd07 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:54.068889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3b9104cd-0ca9-4406-aa17-27283451fd07 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1674 microversion: 2.1 time: 0.155348 Jul 14 12:21:54.069453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 271/552] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:53 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:54.330462 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-bc04d936-456b-4339-b83e-202afa03d496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:54.331164 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-bc04d936-456b-4339-b83e-202afa03d496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:54.339040 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bc04d936-456b-4339-b83e-202afa03d496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:54.339649 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bc04d936-456b-4339-b83e-202afa03d496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:54.340589 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bc04d936-456b-4339-b83e-202afa03d496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:54.341137 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bc04d936-456b-4339-b83e-202afa03d496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:54.476036 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-bc04d936-456b-4339-b83e-202afa03d496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:54.484641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-bc04d936-456b-4339-b83e-202afa03d496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:54.486159 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-bc04d936-456b-4339-b83e-202afa03d496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:54.487339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-bc04d936-456b-4339-b83e-202afa03d496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1742 microversion: 2.20 time: 0.160913 Jul 14 12:21:54.487915 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 282/553] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:54 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1742 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:55.085502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c36b5269-640c-4905-ad23-638168c83db0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:55.086271 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c36b5269-640c-4905-ad23-638168c83db0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:55.093031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c36b5269-640c-4905-ad23-638168c83db0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:55.093480 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c36b5269-640c-4905-ad23-638168c83db0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:55.094276 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c36b5269-640c-4905-ad23-638168c83db0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:55.094714 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c36b5269-640c-4905-ad23-638168c83db0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:55.238721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c36b5269-640c-4905-ad23-638168c83db0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:55.248196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c36b5269-640c-4905-ad23-638168c83db0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1674 microversion: 2.1 time: 0.166489 Jul 14 12:21:55.249135 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 272/554] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:55 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:55.279572 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-83c7bcae-0c26-466f-931c-5e6c0bb85d4c req-1f6f84ec-f9fc-49b6-86f8-e614507c24c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88a179-83e5-4361-8948-8a2632512eaf", "name": "network-vif-plugged", "status": "completed", "tag": "0091e22f-2f09-4a5d-9bd6-143e3f69992b"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:55.288721 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-83c7bcae-0c26-466f-931c-5e6c0bb85d4c req-1f6f84ec-f9fc-49b6-86f8-e614507c24c8 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:55.289338 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-83c7bcae-0c26-466f-931c-5e6c0bb85d4c req-1f6f84ec-f9fc-49b6-86f8-e614507c24c8 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:55.301898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-83c7bcae-0c26-466f-931c-5e6c0bb85d4c req-1f6f84ec-f9fc-49b6-86f8-e614507c24c8 service nova] Creating event network-vif-plugged:0091e22f-2f09-4a5d-9bd6-143e3f69992b for instance 4d88a179-83e5-4361-8948-8a2632512eaf on hv-cinder-84890 Jul 14 12:21:55.306979 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-83c7bcae-0c26-466f-931c-5e6c0bb85d4c req-1f6f84ec-f9fc-49b6-86f8-e614507c24c8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031600 Jul 14 12:21:55.307669 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 283/555] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:21:55.519699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f6c71574-f9c5-46f5-b723-5e56315f5d16 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:55.520223 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f6c71574-f9c5-46f5-b723-5e56315f5d16 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:55.528196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f6c71574-f9c5-46f5-b723-5e56315f5d16 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:55.528791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f6c71574-f9c5-46f5-b723-5e56315f5d16 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:55.529676 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f6c71574-f9c5-46f5-b723-5e56315f5d16 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:55.530113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f6c71574-f9c5-46f5-b723-5e56315f5d16 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:55.534499 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:55.708849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f6c71574-f9c5-46f5-b723-5e56315f5d16 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:55.717206 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f6c71574-f9c5-46f5-b723-5e56315f5d16 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:55.719046 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f6c71574-f9c5-46f5-b723-5e56315f5d16 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:55.720219 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f6c71574-f9c5-46f5-b723-5e56315f5d16 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1737 microversion: 2.20 time: 0.204481 Jul 14 12:21:55.720787 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 273/556] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:55 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:56.272393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:21:56.278124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2a8996ea-afe9-44ee-9f4a-9b9ed3ed670e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:56.279054 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2a8996ea-afe9-44ee-9f4a-9b9ed3ed670e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:56.286173 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2a8996ea-afe9-44ee-9f4a-9b9ed3ed670e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:56.292153 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2a8996ea-afe9-44ee-9f4a-9b9ed3ed670e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:56.292153 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2a8996ea-afe9-44ee-9f4a-9b9ed3ed670e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:56.292153 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2a8996ea-afe9-44ee-9f4a-9b9ed3ed670e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:56.443530 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2a8996ea-afe9-44ee-9f4a-9b9ed3ed670e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:56.451998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2a8996ea-afe9-44ee-9f4a-9b9ed3ed670e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1674 microversion: 2.1 time: 0.188952 Jul 14 12:21:56.452684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 284/557] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:56 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1674 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:56.751847 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-dd229e58-522e-48e5-83fc-d11758e42494 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:56.755833 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-dd229e58-522e-48e5-83fc-d11758e42494 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:56.759691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dd229e58-522e-48e5-83fc-d11758e42494 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:56.760344 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dd229e58-522e-48e5-83fc-d11758e42494 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:56.761282 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dd229e58-522e-48e5-83fc-d11758e42494 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:56.761872 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dd229e58-522e-48e5-83fc-d11758e42494 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:56.988317 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-dd229e58-522e-48e5-83fc-d11758e42494 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:56.998922 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-dd229e58-522e-48e5-83fc-d11758e42494 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:57.001042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-dd229e58-522e-48e5-83fc-d11758e42494 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:57.002409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-dd229e58-522e-48e5-83fc-d11758e42494 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1737 microversion: 2.20 time: 0.254393 Jul 14 12:21:57.003295 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 274/558] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:56 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:57.472198 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-bb9bb67f-7f2f-4014-ab48-15b86cd3e843 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:57.480374 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-bb9bb67f-7f2f-4014-ab48-15b86cd3e843 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:57.487482 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bb9bb67f-7f2f-4014-ab48-15b86cd3e843 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:57.488414 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bb9bb67f-7f2f-4014-ab48-15b86cd3e843 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:57.490038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bb9bb67f-7f2f-4014-ab48-15b86cd3e843 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:57.490684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bb9bb67f-7f2f-4014-ab48-15b86cd3e843 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:57.662272 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-bb9bb67f-7f2f-4014-ab48-15b86cd3e843 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:57.670898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-bb9bb67f-7f2f-4014-ab48-15b86cd3e843 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1674 microversion: 2.1 time: 0.204392 Jul 14 12:21:57.671653 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 285/559] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:57 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1674 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:58.025226 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-952dfb7d-00f3-47c6-8f65-63b735e3c3d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:58.026618 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-952dfb7d-00f3-47c6-8f65-63b735e3c3d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:58.034217 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-952dfb7d-00f3-47c6-8f65-63b735e3c3d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:58.034659 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-952dfb7d-00f3-47c6-8f65-63b735e3c3d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:58.036958 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-952dfb7d-00f3-47c6-8f65-63b735e3c3d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:58.037618 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-952dfb7d-00f3-47c6-8f65-63b735e3c3d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:58.260021 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-952dfb7d-00f3-47c6-8f65-63b735e3c3d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:58.268196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-952dfb7d-00f3-47c6-8f65-63b735e3c3d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:58.269915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-952dfb7d-00f3-47c6-8f65-63b735e3c3d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:58.271110 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-952dfb7d-00f3-47c6-8f65-63b735e3c3d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1737 microversion: 2.20 time: 0.250616 Jul 14 12:21:58.271661 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 275/560] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:58 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:21:58.688686 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-dda9582f-7604-4f25-a720-e104764820c5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:58.689786 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-dda9582f-7604-4f25-a720-e104764820c5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:58.699276 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dda9582f-7604-4f25-a720-e104764820c5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:58.699870 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dda9582f-7604-4f25-a720-e104764820c5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:58.700786 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dda9582f-7604-4f25-a720-e104764820c5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:58.701405 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dda9582f-7604-4f25-a720-e104764820c5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:58.890423 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dda9582f-7604-4f25-a720-e104764820c5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:58.901064 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-dda9582f-7604-4f25-a720-e104764820c5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1651 microversion: 2.1 time: 0.216377 Jul 14 12:21:58.903140 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 286/561] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:58 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1651 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:58.920474 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8244ffa2-8675-498a-b6ac-129b45e7b7f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:21:58.939145 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8244ffa2-8675-498a-b6ac-129b45e7b7f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:58.941536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8244ffa2-8675-498a-b6ac-129b45e7b7f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:58.967652 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8244ffa2-8675-498a-b6ac-129b45e7b7f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Going to try to start instance {{(pid=118263) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 12:21:59.099330 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b82ee006-e9ad-4de6-9478-3e10dcac03e2 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:59.105789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b82ee006-e9ad-4de6-9478-3e10dcac03e2 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:59.107141 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b82ee006-e9ad-4de6-9478-3e10dcac03e2 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:59.107722 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b82ee006-e9ad-4de6-9478-3e10dcac03e2 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:59.108590 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b82ee006-e9ad-4de6-9478-3e10dcac03e2 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:59.109157 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b82ee006-e9ad-4de6-9478-3e10dcac03e2 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:59.129308 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8244ffa2-8675-498a-b6ac-129b45e7b7f1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/action" status: 202 len: 0 microversion: 2.1 time: 0.211881 Jul 14 12:21:59.130087 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 276/562] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:21:58 2022] POST /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:21:59.143712 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-82681f4c-cc8f-462b-ba71-8d888645f98e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:59.147318 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-82681f4c-cc8f-462b-ba71-8d888645f98e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:59.162347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82681f4c-cc8f-462b-ba71-8d888645f98e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:59.163086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82681f4c-cc8f-462b-ba71-8d888645f98e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:59.164018 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82681f4c-cc8f-462b-ba71-8d888645f98e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:59.164578 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82681f4c-cc8f-462b-ba71-8d888645f98e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:59.283070 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b82ee006-e9ad-4de6-9478-3e10dcac03e2 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:59.301801 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b82ee006-e9ad-4de6-9478-3e10dcac03e2 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1593 microversion: 2.1 time: 0.207299 Jul 14 12:21:59.303344 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 287/563] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:59 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1593 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:21:59.308279 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-df1ffe69-9ec0-4151-a0db-86f7e3840f90 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:21:59.309092 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-df1ffe69-9ec0-4151-a0db-86f7e3840f90 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:21:59.316490 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-df1ffe69-9ec0-4151-a0db-86f7e3840f90 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:59.317134 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-df1ffe69-9ec0-4151-a0db-86f7e3840f90 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:59.318088 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-df1ffe69-9ec0-4151-a0db-86f7e3840f90 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:21:59.318678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-df1ffe69-9ec0-4151-a0db-86f7e3840f90 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:21:59.429321 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-82681f4c-cc8f-462b-ba71-8d888645f98e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:59.438103 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-82681f4c-cc8f-462b-ba71-8d888645f98e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1660 microversion: 2.1 time: 0.299580 Jul 14 12:21:59.454067 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 277/564] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:21:59 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1660 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:21:59.534268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-df1ffe69-9ec0-4151-a0db-86f7e3840f90 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:59.544833 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-df1ffe69-9ec0-4151-a0db-86f7e3840f90 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:59.547930 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-df1ffe69-9ec0-4151-a0db-86f7e3840f90 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:21:59.549543 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-df1ffe69-9ec0-4151-a0db-86f7e3840f90 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1737 microversion: 2.20 time: 0.245037 Jul 14 12:21:59.550378 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 288/565] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:21:59 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1737 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:00.461957 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-447e7c59-1749-4e55-bea4-97728fac94e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:00.463629 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-447e7c59-1749-4e55-bea4-97728fac94e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:00.476606 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-447e7c59-1749-4e55-bea4-97728fac94e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:00.479595 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-447e7c59-1749-4e55-bea4-97728fac94e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:00.479595 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-447e7c59-1749-4e55-bea4-97728fac94e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:00.479595 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-447e7c59-1749-4e55-bea4-97728fac94e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:00.569082 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-34c1b1fc-0ec3-4371-ab55-643dcb7fbe72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:00.569697 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-34c1b1fc-0ec3-4371-ab55-643dcb7fbe72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:00.587477 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34c1b1fc-0ec3-4371-ab55-643dcb7fbe72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:00.588867 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34c1b1fc-0ec3-4371-ab55-643dcb7fbe72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:00.593773 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34c1b1fc-0ec3-4371-ab55-643dcb7fbe72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:00.594477 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34c1b1fc-0ec3-4371-ab55-643dcb7fbe72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:00.669236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-447e7c59-1749-4e55-bea4-97728fac94e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:00.677148 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-447e7c59-1749-4e55-bea4-97728fac94e8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1660 microversion: 2.1 time: 0.219400 Jul 14 12:22:00.678697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 278/566] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:00 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1660 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:00.877454 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-34c1b1fc-0ec3-4371-ab55-643dcb7fbe72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:00.886603 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-34c1b1fc-0ec3-4371-ab55-643dcb7fbe72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:00.888761 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-34c1b1fc-0ec3-4371-ab55-643dcb7fbe72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:00.890670 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-34c1b1fc-0ec3-4371-ab55-643dcb7fbe72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1737 microversion: 2.20 time: 0.325649 Jul 14 12:22:00.903360 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 289/567] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:00 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1737 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:22:01.699445 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-18fb2359-aff4-42de-a78c-ca382e5c3f85 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:01.700220 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-18fb2359-aff4-42de-a78c-ca382e5c3f85 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:01.706597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-18fb2359-aff4-42de-a78c-ca382e5c3f85 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:01.707076 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-18fb2359-aff4-42de-a78c-ca382e5c3f85 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:01.707816 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-18fb2359-aff4-42de-a78c-ca382e5c3f85 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:01.708333 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-18fb2359-aff4-42de-a78c-ca382e5c3f85 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:01.873975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-18fb2359-aff4-42de-a78c-ca382e5c3f85 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:01.882089 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-18fb2359-aff4-42de-a78c-ca382e5c3f85 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1664 microversion: 2.1 time: 0.187483 Jul 14 12:22:01.882776 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 279/568] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:01 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1664 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:22:01.912724 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1eb0506d-ed52-4721-92c2-47898467f8ab tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:01.913381 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1eb0506d-ed52-4721-92c2-47898467f8ab tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:01.920533 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1eb0506d-ed52-4721-92c2-47898467f8ab tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:01.921007 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1eb0506d-ed52-4721-92c2-47898467f8ab tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:01.921994 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1eb0506d-ed52-4721-92c2-47898467f8ab tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:01.922431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1eb0506d-ed52-4721-92c2-47898467f8ab tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:02.142576 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1eb0506d-ed52-4721-92c2-47898467f8ab tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:02.158240 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1eb0506d-ed52-4721-92c2-47898467f8ab tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:02.160295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1eb0506d-ed52-4721-92c2-47898467f8ab tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:02.164035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1eb0506d-ed52-4721-92c2-47898467f8ab tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1737 microversion: 2.20 time: 0.255211 Jul 14 12:22:02.168135 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 290/569] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:01 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1737 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:02.933346 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-e053d657-2fb2-4657-8f7c-e72b5dbaa122 req-da33b9c7-4528-4245-a947-e716c18c5817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357e6fda-615e-4e1a-9f33-552398705e3e", "tag": "8d1d4c31-5832-429c-8506-0433ac2a974b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:02.946657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-e053d657-2fb2-4657-8f7c-e72b5dbaa122 req-da33b9c7-4528-4245-a947-e716c18c5817 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:02.947133 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-e053d657-2fb2-4657-8f7c-e72b5dbaa122 req-da33b9c7-4528-4245-a947-e716c18c5817 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:02.959804 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-e053d657-2fb2-4657-8f7c-e72b5dbaa122 req-da33b9c7-4528-4245-a947-e716c18c5817 service nova] Creating event network-changed:8d1d4c31-5832-429c-8506-0433ac2a974b for instance 357e6fda-615e-4e1a-9f33-552398705e3e on hv-cinder-84890 Jul 14 12:22:02.965772 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-e053d657-2fb2-4657-8f7c-e72b5dbaa122 req-da33b9c7-4528-4245-a947-e716c18c5817 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036628 Jul 14 12:22:02.966924 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 280/570] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:22:03.185973 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5b9d2d7d-9087-4f37-b744-8671a4a86b10 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:03.187217 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5b9d2d7d-9087-4f37-b744-8671a4a86b10 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:03.197666 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b9d2d7d-9087-4f37-b744-8671a4a86b10 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:03.198409 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b9d2d7d-9087-4f37-b744-8671a4a86b10 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:03.199399 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b9d2d7d-9087-4f37-b744-8671a4a86b10 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:03.200012 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b9d2d7d-9087-4f37-b744-8671a4a86b10 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:03.435070 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5b9d2d7d-9087-4f37-b744-8671a4a86b10 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:03.461059 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5b9d2d7d-9087-4f37-b744-8671a4a86b10 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:03.464119 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5b9d2d7d-9087-4f37-b744-8671a4a86b10 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:03.475230 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5b9d2d7d-9087-4f37-b744-8671a4a86b10 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1737 microversion: 2.20 time: 0.283527 Jul 14 12:22:03.475230 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 291/571] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:03 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1737 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:04.486088 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0db80416-050d-45ce-b389-eb474d49e36c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:04.487366 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0db80416-050d-45ce-b389-eb474d49e36c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:04.499225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0db80416-050d-45ce-b389-eb474d49e36c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:04.499225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0db80416-050d-45ce-b389-eb474d49e36c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:04.499225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0db80416-050d-45ce-b389-eb474d49e36c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:04.499225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0db80416-050d-45ce-b389-eb474d49e36c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:04.691513 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0db80416-050d-45ce-b389-eb474d49e36c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:04.707081 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0db80416-050d-45ce-b389-eb474d49e36c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:04.708858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0db80416-050d-45ce-b389-eb474d49e36c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:04.710064 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0db80416-050d-45ce-b389-eb474d49e36c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1737 microversion: 2.20 time: 0.228918 Jul 14 12:22:04.725175 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 281/572] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:04 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:05.728987 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-04806fdc-ff70-42e0-8dfa-faf55937ee0e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:05.730955 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-04806fdc-ff70-42e0-8dfa-faf55937ee0e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:05.737787 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04806fdc-ff70-42e0-8dfa-faf55937ee0e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:05.738245 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04806fdc-ff70-42e0-8dfa-faf55937ee0e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:05.739106 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04806fdc-ff70-42e0-8dfa-faf55937ee0e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:05.742287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04806fdc-ff70-42e0-8dfa-faf55937ee0e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:05.882953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-04806fdc-ff70-42e0-8dfa-faf55937ee0e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:05.895832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-04806fdc-ff70-42e0-8dfa-faf55937ee0e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:05.897483 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-04806fdc-ff70-42e0-8dfa-faf55937ee0e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:05.903348 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-04806fdc-ff70-42e0-8dfa-faf55937ee0e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1737 microversion: 2.20 time: 0.178751 Jul 14 12:22:05.904390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 292/573] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:05 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:06.100307 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-11014b9d-b9a3-4cff-8082-924e986f613e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2002398843"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:06.101495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-11014b9d-b9a3-4cff-8082-924e986f613e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:06.109360 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-11014b9d-b9a3-4cff-8082-924e986f613e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:06.109819 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-11014b9d-b9a3-4cff-8082-924e986f613e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:06.110665 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-11014b9d-b9a3-4cff-8082-924e986f613e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:06.111141 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-11014b9d-b9a3-4cff-8082-924e986f613e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:06.276979 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.network.security_group_api [None req-11014b9d-b9a3-4cff-8082-924e986f613e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Adding security group 6e316a0d-e175-4a0e-b542-f87e0ab50f92 to port 8d1d4c31-5832-429c-8506-0433ac2a974b Jul 14 12:22:06.681536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-11014b9d-b9a3-4cff-8082-924e986f613e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "POST /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/action" status: 202 len: 0 microversion: 2.1 time: 0.584910 Jul 14 12:22:06.682239 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 282/574] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:22:06 2022] POST /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/action => generated 0 bytes in 587 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:22:06.691141 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-f2b80bef-55fd-488f-9058-f4a223166006 req-933fcf83-6a60-404f-ba7d-dd31af86b5e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357e6fda-615e-4e1a-9f33-552398705e3e", "tag": "8d1d4c31-5832-429c-8506-0433ac2a974b"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:06.691777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5ee61f4f-7d11-4591-bbf2-1eb53d684869 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:06.692402 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5ee61f4f-7d11-4591-bbf2-1eb53d684869 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:06.698573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5ee61f4f-7d11-4591-bbf2-1eb53d684869 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:06.699329 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5ee61f4f-7d11-4591-bbf2-1eb53d684869 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:06.702701 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5ee61f4f-7d11-4591-bbf2-1eb53d684869 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:06.703328 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-f2b80bef-55fd-488f-9058-f4a223166006 req-933fcf83-6a60-404f-ba7d-dd31af86b5e8 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:06.703450 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5ee61f4f-7d11-4591-bbf2-1eb53d684869 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:06.703550 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-f2b80bef-55fd-488f-9058-f4a223166006 req-933fcf83-6a60-404f-ba7d-dd31af86b5e8 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:06.722125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-f2b80bef-55fd-488f-9058-f4a223166006 req-933fcf83-6a60-404f-ba7d-dd31af86b5e8 service nova] Creating event network-changed:8d1d4c31-5832-429c-8506-0433ac2a974b for instance 357e6fda-615e-4e1a-9f33-552398705e3e on hv-cinder-84890 Jul 14 12:22:06.730574 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-f2b80bef-55fd-488f-9058-f4a223166006 req-933fcf83-6a60-404f-ba7d-dd31af86b5e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044813 Jul 14 12:22:06.737842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 293/575] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:22:06.926121 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-53b25499-31a2-4886-bb76-6f54676f283f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:06.928624 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-53b25499-31a2-4886-bb76-6f54676f283f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:06.939949 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53b25499-31a2-4886-bb76-6f54676f283f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:06.941334 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53b25499-31a2-4886-bb76-6f54676f283f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:06.942204 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53b25499-31a2-4886-bb76-6f54676f283f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:06.942720 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53b25499-31a2-4886-bb76-6f54676f283f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:06.949734 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5ee61f4f-7d11-4591-bbf2-1eb53d684869 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:06.962673 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5ee61f4f-7d11-4591-bbf2-1eb53d684869 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1758 microversion: 2.1 time: 0.274966 Jul 14 12:22:06.964266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 283/576] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:06 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1758 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:06.983274 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:07.110315 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-53b25499-31a2-4886-bb76-6f54676f283f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:07.120745 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-53b25499-31a2-4886-bb76-6f54676f283f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:07.126146 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-53b25499-31a2-4886-bb76-6f54676f283f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:07.126146 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-53b25499-31a2-4886-bb76-6f54676f283f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1737 microversion: 2.20 time: 0.205247 Jul 14 12:22:07.126146 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 294/577] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:06 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:08.141401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-083183f4-afcd-48e4-8acd-482ec2c807f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:08.142122 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-083183f4-afcd-48e4-8acd-482ec2c807f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:08.149290 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-083183f4-afcd-48e4-8acd-482ec2c807f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:08.149755 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-083183f4-afcd-48e4-8acd-482ec2c807f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:08.150560 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-083183f4-afcd-48e4-8acd-482ec2c807f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:08.151027 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-083183f4-afcd-48e4-8acd-482ec2c807f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:08.353082 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-083183f4-afcd-48e4-8acd-482ec2c807f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:08.361260 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-083183f4-afcd-48e4-8acd-482ec2c807f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:08.362894 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-083183f4-afcd-48e4-8acd-482ec2c807f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:08.364031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-083183f4-afcd-48e4-8acd-482ec2c807f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1719 microversion: 2.20 time: 0.226541 Jul 14 12:22:08.364590 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 284/578] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:08 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1719 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:09.382350 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-840b62f8-edd3-45c3-a88f-f2a048384b89 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:09.382986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-840b62f8-edd3-45c3-a88f-f2a048384b89 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:09.389999 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-840b62f8-edd3-45c3-a88f-f2a048384b89 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:09.390473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-840b62f8-edd3-45c3-a88f-f2a048384b89 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:09.391268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-840b62f8-edd3-45c3-a88f-f2a048384b89 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:09.391703 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-840b62f8-edd3-45c3-a88f-f2a048384b89 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:09.524512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-840b62f8-edd3-45c3-a88f-f2a048384b89 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:09.532579 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-840b62f8-edd3-45c3-a88f-f2a048384b89 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:09.534081 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-840b62f8-edd3-45c3-a88f-f2a048384b89 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:09.535248 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-840b62f8-edd3-45c3-a88f-f2a048384b89 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1719 microversion: 2.20 time: 0.156814 Jul 14 12:22:09.535809 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 295/579] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:09 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1719 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:09.593145 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f92a9643-234f-4f82-9b66-a2c2ccf42d8d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ef9fabbb-f37d-4d69-913e-d4c9890f841e", "device": "/dev/sdb"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:09.594951 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f92a9643-234f-4f82-9b66-a2c2ccf42d8d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:09.601444 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f92a9643-234f-4f82-9b66-a2c2ccf42d8d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:09.602413 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f92a9643-234f-4f82-9b66-a2c2ccf42d8d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:09.603306 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f92a9643-234f-4f82-9b66-a2c2ccf42d8d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:09.603743 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f92a9643-234f-4f82-9b66-a2c2ccf42d8d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:10.553866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0734c29b-5ba3-4869-949e-758014cfbcc4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:10.554404 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0734c29b-5ba3-4869-949e-758014cfbcc4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:10.561377 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0734c29b-5ba3-4869-949e-758014cfbcc4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:10.561826 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0734c29b-5ba3-4869-949e-758014cfbcc4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:10.562588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0734c29b-5ba3-4869-949e-758014cfbcc4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:10.563044 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0734c29b-5ba3-4869-949e-758014cfbcc4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:10.690634 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0734c29b-5ba3-4869-949e-758014cfbcc4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:10.699281 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0734c29b-5ba3-4869-949e-758014cfbcc4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:10.700796 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0734c29b-5ba3-4869-949e-758014cfbcc4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:10.701944 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0734c29b-5ba3-4869-949e-758014cfbcc4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1719 microversion: 2.20 time: 0.152165 Jul 14 12:22:10.702510 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 296/580] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:10 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:22:11.375674 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-28a36d0e-1896-4712-831d-90e80aa51e39 req-a1189680-8560-438d-b873-ade6aeab82ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88a179-83e5-4361-8948-8a2632512eaf", "name": "network-vif-unplugged", "status": "completed", "tag": "0091e22f-2f09-4a5d-9bd6-143e3f69992b"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:11.383963 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-28a36d0e-1896-4712-831d-90e80aa51e39 req-a1189680-8560-438d-b873-ade6aeab82ea service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:11.384416 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-28a36d0e-1896-4712-831d-90e80aa51e39 req-a1189680-8560-438d-b873-ade6aeab82ea service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:11.401130 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-28a36d0e-1896-4712-831d-90e80aa51e39 req-a1189680-8560-438d-b873-ade6aeab82ea service nova] Creating event network-vif-unplugged:0091e22f-2f09-4a5d-9bd6-143e3f69992b for instance 4d88a179-83e5-4361-8948-8a2632512eaf on hv-cinder-84890 Jul 14 12:22:11.406747 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-28a36d0e-1896-4712-831d-90e80aa51e39 req-a1189680-8560-438d-b873-ade6aeab82ea service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034815 Jul 14 12:22:11.407391 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 297/581] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:22:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:22:11.528699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f92a9643-234f-4f82-9b66-a2c2ccf42d8d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "POST /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.939431 Jul 14 12:22:11.529315 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 285/582] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:22:09 2022] POST /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3/os-volume_attachments => generated 194 bytes in 1941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:22:11.721168 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3e60e835-e23e-497f-b4d7-715fbb091dbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:11.721959 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3e60e835-e23e-497f-b4d7-715fbb091dbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:11.729365 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3e60e835-e23e-497f-b4d7-715fbb091dbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:11.729557 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3e60e835-e23e-497f-b4d7-715fbb091dbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:11.730335 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3e60e835-e23e-497f-b4d7-715fbb091dbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:11.730792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3e60e835-e23e-497f-b4d7-715fbb091dbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:11.864763 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3e60e835-e23e-497f-b4d7-715fbb091dbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:11.873303 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3e60e835-e23e-497f-b4d7-715fbb091dbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:11.874838 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3e60e835-e23e-497f-b4d7-715fbb091dbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:11.875983 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3e60e835-e23e-497f-b4d7-715fbb091dbc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1722 microversion: 2.20 time: 0.159090 Jul 14 12:22:11.876545 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 298/583] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:11 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:11.894736 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3d9cf886-3484-4c01-ba85-8834452d5cea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4c9dec89-4443-40dc-a98a-19eda6392efb"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:11.896054 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3d9cf886-3484-4c01-ba85-8834452d5cea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:11.903196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3d9cf886-3484-4c01-ba85-8834452d5cea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:11.903648 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3d9cf886-3484-4c01-ba85-8834452d5cea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:11.904572 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3d9cf886-3484-4c01-ba85-8834452d5cea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:11.905011 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3d9cf886-3484-4c01-ba85-8834452d5cea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:12.556963 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:12.997990 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3d9cf886-3484-4c01-ba85-8834452d5cea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "POST /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.107913 Jul 14 12:22:12.998694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 286/584] 10.222.0.27 () {62 vars in 1363 bytes} [Thu Jul 14 12:22:11 2022] POST /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments => generated 188 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:22:13.114403 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1171e61f-d41b-4083-bf6c-5961b78d3b68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:13.115012 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1171e61f-d41b-4083-bf6c-5961b78d3b68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:13.122262 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1171e61f-d41b-4083-bf6c-5961b78d3b68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:13.122716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1171e61f-d41b-4083-bf6c-5961b78d3b68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:13.123517 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1171e61f-d41b-4083-bf6c-5961b78d3b68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:13.123958 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1171e61f-d41b-4083-bf6c-5961b78d3b68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:13.343389 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1171e61f-d41b-4083-bf6c-5961b78d3b68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "POST /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/action" status: 202 len: 0 microversion: 2.20 time: 0.232769 Jul 14 12:22:13.343934 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 299/585] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jul 14 12:22:13 2022] POST /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:22:13.352186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-84e7191d-b2ab-421d-a60c-d3aa9fb76cb2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:13.368381 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-84e7191d-b2ab-421d-a60c-d3aa9fb76cb2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:13.368381 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84e7191d-b2ab-421d-a60c-d3aa9fb76cb2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:13.368381 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84e7191d-b2ab-421d-a60c-d3aa9fb76cb2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:13.368381 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84e7191d-b2ab-421d-a60c-d3aa9fb76cb2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:13.369438 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84e7191d-b2ab-421d-a60c-d3aa9fb76cb2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:13.493740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-84e7191d-b2ab-421d-a60c-d3aa9fb76cb2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:13.502388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-84e7191d-b2ab-421d-a60c-d3aa9fb76cb2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:13.503920 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-84e7191d-b2ab-421d-a60c-d3aa9fb76cb2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:13.505075 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-84e7191d-b2ab-421d-a60c-d3aa9fb76cb2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1748 microversion: 2.20 time: 0.157008 Jul 14 12:22:13.505634 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 287/586] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:13 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:14.524499 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3f5355ab-0d54-4ebb-b7a2-eab37a28a098 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:14.525101 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3f5355ab-0d54-4ebb-b7a2-eab37a28a098 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:14.531225 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f5355ab-0d54-4ebb-b7a2-eab37a28a098 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:14.531675 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f5355ab-0d54-4ebb-b7a2-eab37a28a098 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:14.532432 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f5355ab-0d54-4ebb-b7a2-eab37a28a098 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:14.532867 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f5355ab-0d54-4ebb-b7a2-eab37a28a098 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:14.663244 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3f5355ab-0d54-4ebb-b7a2-eab37a28a098 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:14.672692 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3f5355ab-0d54-4ebb-b7a2-eab37a28a098 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:14.674268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3f5355ab-0d54-4ebb-b7a2-eab37a28a098 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:14.675447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3f5355ab-0d54-4ebb-b7a2-eab37a28a098 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1748 microversion: 2.20 time: 0.155398 Jul 14 12:22:14.679010 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 300/587] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:14 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:15.695758 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-71c3d644-1a8b-40a9-a8e9-b6191d95f5b9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:15.696457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-71c3d644-1a8b-40a9-a8e9-b6191d95f5b9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:15.698801 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=66 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:15.703683 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-71c3d644-1a8b-40a9-a8e9-b6191d95f5b9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:15.704141 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-71c3d644-1a8b-40a9-a8e9-b6191d95f5b9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:15.704901 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-71c3d644-1a8b-40a9-a8e9-b6191d95f5b9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:15.705338 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-71c3d644-1a8b-40a9-a8e9-b6191d95f5b9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:15.834416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-71c3d644-1a8b-40a9-a8e9-b6191d95f5b9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:15.842938 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-71c3d644-1a8b-40a9-a8e9-b6191d95f5b9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:15.844453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-71c3d644-1a8b-40a9-a8e9-b6191d95f5b9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:15.845602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-71c3d644-1a8b-40a9-a8e9-b6191d95f5b9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1750 microversion: 2.20 time: 0.154267 Jul 14 12:22:15.846208 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 288/588] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:15 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:16.864113 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a35989ea-e099-4f66-a544-5c840edd3460 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:16.864726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a35989ea-e099-4f66-a544-5c840edd3460 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:16.871537 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a35989ea-e099-4f66-a544-5c840edd3460 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:16.871988 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a35989ea-e099-4f66-a544-5c840edd3460 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:16.872787 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a35989ea-e099-4f66-a544-5c840edd3460 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:16.873225 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a35989ea-e099-4f66-a544-5c840edd3460 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:17.006274 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a35989ea-e099-4f66-a544-5c840edd3460 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:17.015251 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a35989ea-e099-4f66-a544-5c840edd3460 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:17.016752 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a35989ea-e099-4f66-a544-5c840edd3460 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:17.017895 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a35989ea-e099-4f66-a544-5c840edd3460 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1750 microversion: 2.20 time: 0.157661 Jul 14 12:22:17.019041 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 301/589] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:16 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:18.037668 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-90f46ab3-e481-48e7-9175-371922a97873 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:18.038210 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-90f46ab3-e481-48e7-9175-371922a97873 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:18.045347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-90f46ab3-e481-48e7-9175-371922a97873 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:18.045797 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-90f46ab3-e481-48e7-9175-371922a97873 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:18.046846 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-90f46ab3-e481-48e7-9175-371922a97873 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:18.047284 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-90f46ab3-e481-48e7-9175-371922a97873 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:18.177910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-90f46ab3-e481-48e7-9175-371922a97873 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:18.186202 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-90f46ab3-e481-48e7-9175-371922a97873 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:18.187746 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-90f46ab3-e481-48e7-9175-371922a97873 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:18.188870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-90f46ab3-e481-48e7-9175-371922a97873 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1750 microversion: 2.20 time: 0.155270 Jul 14 12:22:18.189426 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 289/590] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:18 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:19.207128 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0ae148f4-0e90-4264-9171-b085331a04b7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:19.207756 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0ae148f4-0e90-4264-9171-b085331a04b7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:19.210245 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=58 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:19.215437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0ae148f4-0e90-4264-9171-b085331a04b7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:19.215905 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0ae148f4-0e90-4264-9171-b085331a04b7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:19.216678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0ae148f4-0e90-4264-9171-b085331a04b7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:19.217162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0ae148f4-0e90-4264-9171-b085331a04b7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:19.351638 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0ae148f4-0e90-4264-9171-b085331a04b7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:19.360200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0ae148f4-0e90-4264-9171-b085331a04b7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:19.361698 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0ae148f4-0e90-4264-9171-b085331a04b7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:19.362873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0ae148f4-0e90-4264-9171-b085331a04b7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1750 microversion: 2.20 time: 0.159836 Jul 14 12:22:19.363436 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 302/591] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:19 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1750 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:20.381397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ee581600-79a1-4391-bcd7-d15f0b40cd52 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:20.382012 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ee581600-79a1-4391-bcd7-d15f0b40cd52 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:20.389223 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ee581600-79a1-4391-bcd7-d15f0b40cd52 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:20.389705 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ee581600-79a1-4391-bcd7-d15f0b40cd52 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:20.390479 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ee581600-79a1-4391-bcd7-d15f0b40cd52 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:20.392632 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ee581600-79a1-4391-bcd7-d15f0b40cd52 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:20.519139 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ee581600-79a1-4391-bcd7-d15f0b40cd52 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:20.527637 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ee581600-79a1-4391-bcd7-d15f0b40cd52 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:20.529175 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ee581600-79a1-4391-bcd7-d15f0b40cd52 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:20.530326 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ee581600-79a1-4391-bcd7-d15f0b40cd52 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1750 microversion: 2.20 time: 0.152872 Jul 14 12:22:20.530912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 290/592] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:20 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:22:21.549987 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-53f6bd05-a1cc-4ced-8da8-a1f9932f4496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:21.550641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-53f6bd05-a1cc-4ced-8da8-a1f9932f4496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:21.557514 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53f6bd05-a1cc-4ced-8da8-a1f9932f4496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:21.562232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53f6bd05-a1cc-4ced-8da8-a1f9932f4496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:21.562232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53f6bd05-a1cc-4ced-8da8-a1f9932f4496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:21.562232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-53f6bd05-a1cc-4ced-8da8-a1f9932f4496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:21.689388 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-53f6bd05-a1cc-4ced-8da8-a1f9932f4496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:21.699058 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-53f6bd05-a1cc-4ced-8da8-a1f9932f4496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:21.700575 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-53f6bd05-a1cc-4ced-8da8-a1f9932f4496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:21.701736 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-53f6bd05-a1cc-4ced-8da8-a1f9932f4496 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1750 microversion: 2.20 time: 0.156170 Jul 14 12:22:21.702315 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 303/593] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:21 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1750 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:22.720362 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7d62d90c-c695-4cf7-b199-d810a0dd17c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:22.721038 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7d62d90c-c695-4cf7-b199-d810a0dd17c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:22.729263 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7d62d90c-c695-4cf7-b199-d810a0dd17c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:22.730008 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7d62d90c-c695-4cf7-b199-d810a0dd17c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:22.730583 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7d62d90c-c695-4cf7-b199-d810a0dd17c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:22.731097 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7d62d90c-c695-4cf7-b199-d810a0dd17c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:22.863346 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7d62d90c-c695-4cf7-b199-d810a0dd17c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:22.872464 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7d62d90c-c695-4cf7-b199-d810a0dd17c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:22.874002 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7d62d90c-c695-4cf7-b199-d810a0dd17c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:22.875206 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7d62d90c-c695-4cf7-b199-d810a0dd17c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.158924 Jul 14 12:22:22.875869 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 291/594] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:22 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:23.893850 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-db015d70-c76a-404a-aa80-7ab9f4bd01c8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:23.894410 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-db015d70-c76a-404a-aa80-7ab9f4bd01c8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:23.902061 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-db015d70-c76a-404a-aa80-7ab9f4bd01c8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:23.902543 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-db015d70-c76a-404a-aa80-7ab9f4bd01c8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:23.903341 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-db015d70-c76a-404a-aa80-7ab9f4bd01c8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:23.903779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-db015d70-c76a-404a-aa80-7ab9f4bd01c8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:24.046395 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-db015d70-c76a-404a-aa80-7ab9f4bd01c8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:24.054950 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-db015d70-c76a-404a-aa80-7ab9f4bd01c8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:24.056457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-db015d70-c76a-404a-aa80-7ab9f4bd01c8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:24.057684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-db015d70-c76a-404a-aa80-7ab9f4bd01c8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.167714 Jul 14 12:22:24.058244 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 304/595] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:23 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:25.075728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d2288d2b-e1bc-4fa4-bad5-0acad3d437be tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:25.076330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d2288d2b-e1bc-4fa4-bad5-0acad3d437be tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:25.082749 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d2288d2b-e1bc-4fa4-bad5-0acad3d437be tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:25.083218 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d2288d2b-e1bc-4fa4-bad5-0acad3d437be tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:25.083974 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d2288d2b-e1bc-4fa4-bad5-0acad3d437be tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:25.084403 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d2288d2b-e1bc-4fa4-bad5-0acad3d437be tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:25.288010 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d2288d2b-e1bc-4fa4-bad5-0acad3d437be tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:25.298215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d2288d2b-e1bc-4fa4-bad5-0acad3d437be tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:25.299866 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d2288d2b-e1bc-4fa4-bad5-0acad3d437be tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:25.301131 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d2288d2b-e1bc-4fa4-bad5-0acad3d437be tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.229261 Jul 14 12:22:25.302136 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 292/596] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:25 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:26.320963 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-750b6510-5b5f-4c2e-ad8c-4bb3e90362c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:26.321703 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-750b6510-5b5f-4c2e-ad8c-4bb3e90362c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:26.328305 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-750b6510-5b5f-4c2e-ad8c-4bb3e90362c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:26.329783 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-750b6510-5b5f-4c2e-ad8c-4bb3e90362c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:26.330604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-750b6510-5b5f-4c2e-ad8c-4bb3e90362c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:26.331104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-750b6510-5b5f-4c2e-ad8c-4bb3e90362c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:26.465696 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-750b6510-5b5f-4c2e-ad8c-4bb3e90362c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:26.474109 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-750b6510-5b5f-4c2e-ad8c-4bb3e90362c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:26.475649 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-750b6510-5b5f-4c2e-ad8c-4bb3e90362c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:26.476802 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-750b6510-5b5f-4c2e-ad8c-4bb3e90362c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.160497 Jul 14 12:22:26.477367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 305/597] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:26 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:27.494965 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-204442c7-e196-4c6e-8303-b16fad1cca1a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:27.495575 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-204442c7-e196-4c6e-8303-b16fad1cca1a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:27.502036 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-204442c7-e196-4c6e-8303-b16fad1cca1a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:27.502484 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-204442c7-e196-4c6e-8303-b16fad1cca1a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:27.503275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-204442c7-e196-4c6e-8303-b16fad1cca1a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:27.503742 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-204442c7-e196-4c6e-8303-b16fad1cca1a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:27.630401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-204442c7-e196-4c6e-8303-b16fad1cca1a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:27.639955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-204442c7-e196-4c6e-8303-b16fad1cca1a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:27.641449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-204442c7-e196-4c6e-8303-b16fad1cca1a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:27.642594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-204442c7-e196-4c6e-8303-b16fad1cca1a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.151633 Jul 14 12:22:27.643206 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 293/598] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:27 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:28.660941 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f0cf5d49-d820-4f07-8a32-14151eb5c79c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:28.661506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f0cf5d49-d820-4f07-8a32-14151eb5c79c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:28.668693 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0cf5d49-d820-4f07-8a32-14151eb5c79c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:28.669136 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0cf5d49-d820-4f07-8a32-14151eb5c79c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:28.669884 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0cf5d49-d820-4f07-8a32-14151eb5c79c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:28.670310 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0cf5d49-d820-4f07-8a32-14151eb5c79c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:28.806087 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f0cf5d49-d820-4f07-8a32-14151eb5c79c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:28.814391 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f0cf5d49-d820-4f07-8a32-14151eb5c79c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:28.815908 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f0cf5d49-d820-4f07-8a32-14151eb5c79c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:28.817042 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f0cf5d49-d820-4f07-8a32-14151eb5c79c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.160040 Jul 14 12:22:28.817587 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 306/599] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:28 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:29.836672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3bb76955-891c-4f0e-9100-992809d9915e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:29.837545 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3bb76955-891c-4f0e-9100-992809d9915e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:29.844722 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3bb76955-891c-4f0e-9100-992809d9915e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:29.845169 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3bb76955-891c-4f0e-9100-992809d9915e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:29.845957 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3bb76955-891c-4f0e-9100-992809d9915e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:29.846371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3bb76955-891c-4f0e-9100-992809d9915e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:30.004452 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3bb76955-891c-4f0e-9100-992809d9915e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:30.014862 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3bb76955-891c-4f0e-9100-992809d9915e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:30.016385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3bb76955-891c-4f0e-9100-992809d9915e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:30.017543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3bb76955-891c-4f0e-9100-992809d9915e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.185902 Jul 14 12:22:30.018115 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 294/600] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:29 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:31.035854 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a25d6022-432b-4dab-8085-8cf7e6336095 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:31.036405 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a25d6022-432b-4dab-8085-8cf7e6336095 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:31.043580 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a25d6022-432b-4dab-8085-8cf7e6336095 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:31.044033 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a25d6022-432b-4dab-8085-8cf7e6336095 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:31.044813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a25d6022-432b-4dab-8085-8cf7e6336095 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:31.045256 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a25d6022-432b-4dab-8085-8cf7e6336095 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:31.181136 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a25d6022-432b-4dab-8085-8cf7e6336095 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:31.190217 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a25d6022-432b-4dab-8085-8cf7e6336095 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:31.191841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a25d6022-432b-4dab-8085-8cf7e6336095 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:31.193218 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a25d6022-432b-4dab-8085-8cf7e6336095 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.161563 Jul 14 12:22:31.193792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 307/601] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:31 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:32.212563 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e4db20ac-fae6-4c8a-b611-12e6a5227d7b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:32.213142 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e4db20ac-fae6-4c8a-b611-12e6a5227d7b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:32.219717 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e4db20ac-fae6-4c8a-b611-12e6a5227d7b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:32.220153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e4db20ac-fae6-4c8a-b611-12e6a5227d7b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:32.220918 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e4db20ac-fae6-4c8a-b611-12e6a5227d7b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:32.221350 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e4db20ac-fae6-4c8a-b611-12e6a5227d7b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:32.357920 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e4db20ac-fae6-4c8a-b611-12e6a5227d7b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:32.367200 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e4db20ac-fae6-4c8a-b611-12e6a5227d7b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:32.368594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e4db20ac-fae6-4c8a-b611-12e6a5227d7b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:32.369758 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e4db20ac-fae6-4c8a-b611-12e6a5227d7b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.161657 Jul 14 12:22:32.370511 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 295/602] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:32 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:33.392563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-81c001c7-74b9-4985-b37a-abce7abd3623 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:33.394472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-81c001c7-74b9-4985-b37a-abce7abd3623 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:33.404745 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-81c001c7-74b9-4985-b37a-abce7abd3623 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:33.405195 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-81c001c7-74b9-4985-b37a-abce7abd3623 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:33.406079 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-81c001c7-74b9-4985-b37a-abce7abd3623 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:33.406574 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-81c001c7-74b9-4985-b37a-abce7abd3623 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:33.547805 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-81c001c7-74b9-4985-b37a-abce7abd3623 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:33.561238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-81c001c7-74b9-4985-b37a-abce7abd3623 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:33.563117 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-81c001c7-74b9-4985-b37a-abce7abd3623 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:33.564535 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-81c001c7-74b9-4985-b37a-abce7abd3623 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.178035 Jul 14 12:22:33.565270 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 308/603] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:33 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:34.584084 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d444cd5e-8b70-4090-9717-deb952d9f399 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:34.584713 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d444cd5e-8b70-4090-9717-deb952d9f399 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:34.592075 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d444cd5e-8b70-4090-9717-deb952d9f399 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:34.592520 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d444cd5e-8b70-4090-9717-deb952d9f399 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:34.593285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d444cd5e-8b70-4090-9717-deb952d9f399 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:34.593745 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d444cd5e-8b70-4090-9717-deb952d9f399 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:34.740203 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d444cd5e-8b70-4090-9717-deb952d9f399 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:34.750976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d444cd5e-8b70-4090-9717-deb952d9f399 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:34.752506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d444cd5e-8b70-4090-9717-deb952d9f399 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:34.753679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d444cd5e-8b70-4090-9717-deb952d9f399 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.173565 Jul 14 12:22:34.754248 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 296/604] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:34 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:22:35.774412 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-52bf9f6b-8629-4fab-8863-fb4a00d8c753 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:35.775118 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-52bf9f6b-8629-4fab-8863-fb4a00d8c753 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:35.781457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-52bf9f6b-8629-4fab-8863-fb4a00d8c753 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:35.781898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-52bf9f6b-8629-4fab-8863-fb4a00d8c753 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:35.782649 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-52bf9f6b-8629-4fab-8863-fb4a00d8c753 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:35.783135 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-52bf9f6b-8629-4fab-8863-fb4a00d8c753 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:35.937811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-52bf9f6b-8629-4fab-8863-fb4a00d8c753 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:35.947598 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-52bf9f6b-8629-4fab-8863-fb4a00d8c753 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:35.949427 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-52bf9f6b-8629-4fab-8863-fb4a00d8c753 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:35.950617 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-52bf9f6b-8629-4fab-8863-fb4a00d8c753 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.180739 Jul 14 12:22:35.951204 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 309/605] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:35 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:22:36.969514 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3e0b07e7-398a-41d9-9717-fbae5bcf91bb tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:36.970154 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3e0b07e7-398a-41d9-9717-fbae5bcf91bb tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:36.978324 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e0b07e7-398a-41d9-9717-fbae5bcf91bb tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:36.979078 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e0b07e7-398a-41d9-9717-fbae5bcf91bb tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:36.979823 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e0b07e7-398a-41d9-9717-fbae5bcf91bb tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:36.980480 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e0b07e7-398a-41d9-9717-fbae5bcf91bb tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:37.126705 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3e0b07e7-398a-41d9-9717-fbae5bcf91bb tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:37.136414 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3e0b07e7-398a-41d9-9717-fbae5bcf91bb tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:37.138018 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3e0b07e7-398a-41d9-9717-fbae5bcf91bb tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:37.139261 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3e0b07e7-398a-41d9-9717-fbae5bcf91bb tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.173630 Jul 14 12:22:37.139980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 297/606] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:36 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:38.158822 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9848f186-7756-4582-bb4f-22fc89ee9e2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:38.159431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-9848f186-7756-4582-bb4f-22fc89ee9e2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:38.166906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9848f186-7756-4582-bb4f-22fc89ee9e2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:38.167617 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9848f186-7756-4582-bb4f-22fc89ee9e2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:38.168597 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9848f186-7756-4582-bb4f-22fc89ee9e2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:38.169232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9848f186-7756-4582-bb4f-22fc89ee9e2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:38.191576 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:38.193153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-02311422-f43b-4670-96ae-6c7ca34ea030 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:38.193692 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-02311422-f43b-4670-96ae-6c7ca34ea030 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:38.200463 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-02311422-f43b-4670-96ae-6c7ca34ea030 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:38.204291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-02311422-f43b-4670-96ae-6c7ca34ea030 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:38.204291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-02311422-f43b-4670-96ae-6c7ca34ea030 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:38.204291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-02311422-f43b-4670-96ae-6c7ca34ea030 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:38.315396 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9848f186-7756-4582-bb4f-22fc89ee9e2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:38.329182 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9848f186-7756-4582-bb4f-22fc89ee9e2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:38.331019 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9848f186-7756-4582-bb4f-22fc89ee9e2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:38.332191 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9848f186-7756-4582-bb4f-22fc89ee9e2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.177628 Jul 14 12:22:38.334290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 310/607] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:38 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:38.351236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-02311422-f43b-4670-96ae-6c7ca34ea030 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lazy-loading 'services' on Instance uuid 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:22:38.575011 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-02311422-f43b-4670-96ae-6c7ca34ea030 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3/os-volume_attachments/ef9fabbb-f37d-4d69-913e-d4c9890f841e" status: 202 len: 0 microversion: 2.1 time: 0.385437 Jul 14 12:22:38.575910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 298/608] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:22:38 2022] DELETE /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3/os-volume_attachments/ef9fabbb-f37d-4d69-913e-d4c9890f841e => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:22:39.351562 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f0329600-c776-40b5-81aa-4742dfcb284a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:39.352182 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f0329600-c776-40b5-81aa-4742dfcb284a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:39.359325 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0329600-c776-40b5-81aa-4742dfcb284a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:39.367562 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0329600-c776-40b5-81aa-4742dfcb284a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:39.367562 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0329600-c776-40b5-81aa-4742dfcb284a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:39.367562 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0329600-c776-40b5-81aa-4742dfcb284a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:39.496341 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f0329600-c776-40b5-81aa-4742dfcb284a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:39.504652 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f0329600-c776-40b5-81aa-4742dfcb284a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:39.506147 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f0329600-c776-40b5-81aa-4742dfcb284a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:39.507317 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f0329600-c776-40b5-81aa-4742dfcb284a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.160444 Jul 14 12:22:39.507881 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 311/609] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:39 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:40.526737 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-1c90739c-d366-49d9-b180-0b5306594ecf tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:40.527358 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-1c90739c-d366-49d9-b180-0b5306594ecf tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:40.533985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1c90739c-d366-49d9-b180-0b5306594ecf tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:40.534434 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1c90739c-d366-49d9-b180-0b5306594ecf tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:40.535232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1c90739c-d366-49d9-b180-0b5306594ecf tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:40.535669 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1c90739c-d366-49d9-b180-0b5306594ecf tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:40.664864 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1c90739c-d366-49d9-b180-0b5306594ecf tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:40.673543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1c90739c-d366-49d9-b180-0b5306594ecf tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:40.675076 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1c90739c-d366-49d9-b180-0b5306594ecf tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:40.676232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-1c90739c-d366-49d9-b180-0b5306594ecf tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.154347 Jul 14 12:22:40.676791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 299/610] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:40 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:41.695617 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-248daa7a-7b5a-4d33-b33f-0e2cac2ec3f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:41.696221 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-248daa7a-7b5a-4d33-b33f-0e2cac2ec3f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:41.703077 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-248daa7a-7b5a-4d33-b33f-0e2cac2ec3f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:41.703530 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-248daa7a-7b5a-4d33-b33f-0e2cac2ec3f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:41.704299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-248daa7a-7b5a-4d33-b33f-0e2cac2ec3f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:41.704742 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-248daa7a-7b5a-4d33-b33f-0e2cac2ec3f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:41.798372 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0194ce08-f4e1-48eb-8a89-51a4c8089c21 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:41.798943 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0194ce08-f4e1-48eb-8a89-51a4c8089c21 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:41.805819 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0194ce08-f4e1-48eb-8a89-51a4c8089c21 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:41.806477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0194ce08-f4e1-48eb-8a89-51a4c8089c21 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:41.807265 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0194ce08-f4e1-48eb-8a89-51a4c8089c21 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:41.807691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0194ce08-f4e1-48eb-8a89-51a4c8089c21 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:41.833171 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0194ce08-f4e1-48eb-8a89-51a4c8089c21 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Going to try to terminate instance {{(pid=118263) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:22:41.835814 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-248daa7a-7b5a-4d33-b33f-0e2cac2ec3f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:41.844165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-248daa7a-7b5a-4d33-b33f-0e2cac2ec3f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:41.845663 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-248daa7a-7b5a-4d33-b33f-0e2cac2ec3f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:41.846832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-248daa7a-7b5a-4d33-b33f-0e2cac2ec3f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.155983 Jul 14 12:22:41.847395 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 312/611] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:41 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:41.870454 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=95,nova_cell1:UPDATE=3 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:42.151506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0194ce08-f4e1-48eb-8a89-51a4c8089c21 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 204 len: 0 microversion: 2.1 time: 0.356766 Jul 14 12:22:42.152250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 300/612] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:22:41 2022] DELETE /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 12:22:42.160274 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-794feba1-8051-4f8b-9f6e-bf7f1056d1c1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:42.160880 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-794feba1-8051-4f8b-9f6e-bf7f1056d1c1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:42.168484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-794feba1-8051-4f8b-9f6e-bf7f1056d1c1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:42.168926 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-794feba1-8051-4f8b-9f6e-bf7f1056d1c1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:42.169683 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-794feba1-8051-4f8b-9f6e-bf7f1056d1c1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:42.170113 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-794feba1-8051-4f8b-9f6e-bf7f1056d1c1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:42.297419 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-794feba1-8051-4f8b-9f6e-bf7f1056d1c1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:42.305477 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-794feba1-8051-4f8b-9f6e-bf7f1056d1c1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1512 microversion: 2.1 time: 0.149001 Jul 14 12:22:42.306042 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 313/613] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:42 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:42.865947 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-334881c7-944b-4c21-b3ca-ba705016c79b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:42.866707 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-334881c7-944b-4c21-b3ca-ba705016c79b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:42.873221 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-334881c7-944b-4c21-b3ca-ba705016c79b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:42.873668 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-334881c7-944b-4c21-b3ca-ba705016c79b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:42.874424 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-334881c7-944b-4c21-b3ca-ba705016c79b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:42.874892 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-334881c7-944b-4c21-b3ca-ba705016c79b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:43.005408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-334881c7-944b-4c21-b3ca-ba705016c79b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:43.014574 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-334881c7-944b-4c21-b3ca-ba705016c79b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:43.016122 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-334881c7-944b-4c21-b3ca-ba705016c79b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:43.017267 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-334881c7-944b-4c21-b3ca-ba705016c79b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.155632 Jul 14 12:22:43.017828 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 301/614] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:42 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:43.323228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a1c7c0bf-489d-4b37-b947-2e7cab7d2956 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:43.323930 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a1c7c0bf-489d-4b37-b947-2e7cab7d2956 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:43.330740 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a1c7c0bf-489d-4b37-b947-2e7cab7d2956 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:43.331222 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a1c7c0bf-489d-4b37-b947-2e7cab7d2956 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:43.331986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a1c7c0bf-489d-4b37-b947-2e7cab7d2956 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:43.332423 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a1c7c0bf-489d-4b37-b947-2e7cab7d2956 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:43.462277 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a1c7c0bf-489d-4b37-b947-2e7cab7d2956 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:43.469812 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a1c7c0bf-489d-4b37-b947-2e7cab7d2956 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1512 microversion: 2.1 time: 0.151122 Jul 14 12:22:43.470385 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 314/615] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:43 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:44.035688 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-1b54c9b3-df7e-4e20-81e6-c0114d02ab28 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:44.036309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-1b54c9b3-df7e-4e20-81e6-c0114d02ab28 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:44.043963 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1b54c9b3-df7e-4e20-81e6-c0114d02ab28 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:44.044409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1b54c9b3-df7e-4e20-81e6-c0114d02ab28 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:44.045179 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1b54c9b3-df7e-4e20-81e6-c0114d02ab28 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:44.045940 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1b54c9b3-df7e-4e20-81e6-c0114d02ab28 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:44.174926 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1b54c9b3-df7e-4e20-81e6-c0114d02ab28 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:44.183559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1b54c9b3-df7e-4e20-81e6-c0114d02ab28 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:44.185110 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-1b54c9b3-df7e-4e20-81e6-c0114d02ab28 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:44.186257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-1b54c9b3-df7e-4e20-81e6-c0114d02ab28 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.154735 Jul 14 12:22:44.186845 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 302/616] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:44 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:44.487423 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-61d59089-c060-4781-bfba-d242d3aa4d97 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:44.488150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-61d59089-c060-4781-bfba-d242d3aa4d97 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:44.495363 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-61d59089-c060-4781-bfba-d242d3aa4d97 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:44.495809 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-61d59089-c060-4781-bfba-d242d3aa4d97 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:44.496576 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-61d59089-c060-4781-bfba-d242d3aa4d97 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:44.497067 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-61d59089-c060-4781-bfba-d242d3aa4d97 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:44.627892 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-61d59089-c060-4781-bfba-d242d3aa4d97 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:44.635558 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-61d59089-c060-4781-bfba-d242d3aa4d97 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1512 microversion: 2.1 time: 0.152033 Jul 14 12:22:44.636153 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 315/617] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:44 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:44.755845 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-dd581934-d6e2-44eb-9160-2d4fb4167bca req-46942b59-7a7a-4fd6-8425-12d2d1cd65b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bec056f-1ed7-4c1f-9e79-6f44c353d9c3", "name": "network-vif-deleted", "tag": "3eede203-2d63-46df-8338-538ec6d38092"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:44.764117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-dd581934-d6e2-44eb-9160-2d4fb4167bca req-46942b59-7a7a-4fd6-8425-12d2d1cd65b6 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:44.765989 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-dd581934-d6e2-44eb-9160-2d4fb4167bca req-46942b59-7a7a-4fd6-8425-12d2d1cd65b6 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:44.775727 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-dd581934-d6e2-44eb-9160-2d4fb4167bca req-46942b59-7a7a-4fd6-8425-12d2d1cd65b6 service nova] Creating event network-vif-deleted:3eede203-2d63-46df-8338-538ec6d38092 for instance 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 on hv-cinder-84890 Jul 14 12:22:44.780486 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-dd581934-d6e2-44eb-9160-2d4fb4167bca req-46942b59-7a7a-4fd6-8425-12d2d1cd65b6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028282 Jul 14 12:22:44.781064 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 303/618] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:22:45.204976 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-00a9206e-2ec2-40a2-87d1-bab8594cec93 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:45.205582 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-00a9206e-2ec2-40a2-87d1-bab8594cec93 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:45.212245 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-00a9206e-2ec2-40a2-87d1-bab8594cec93 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:45.217109 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-00a9206e-2ec2-40a2-87d1-bab8594cec93 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:45.217109 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-00a9206e-2ec2-40a2-87d1-bab8594cec93 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:45.217109 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-00a9206e-2ec2-40a2-87d1-bab8594cec93 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:45.344715 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-00a9206e-2ec2-40a2-87d1-bab8594cec93 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:45.353417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-00a9206e-2ec2-40a2-87d1-bab8594cec93 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:45.354945 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-00a9206e-2ec2-40a2-87d1-bab8594cec93 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:45.356085 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-00a9206e-2ec2-40a2-87d1-bab8594cec93 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.155050 Jul 14 12:22:45.356641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 316/619] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:45 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:45.653705 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:45.654312 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:45.660655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:45.661106 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:45.661864 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:45.662301 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:45.694614 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:45.696391 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:45.696391 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lazy-loading 'fault' on Instance uuid 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:22:45.737315 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:45.745457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-70b36978-9c38-4c3d-8a14-a0e008dab94d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 200 len: 1308 microversion: 2.1 time: 0.096477 Jul 14 12:22:45.746022 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 304/620] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:45 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:46.374808 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-45f5fa6f-e4b9-4034-9ffa-39aa7c23f87e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:46.375385 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-45f5fa6f-e4b9-4034-9ffa-39aa7c23f87e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:46.382556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45f5fa6f-e4b9-4034-9ffa-39aa7c23f87e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:46.383200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45f5fa6f-e4b9-4034-9ffa-39aa7c23f87e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:46.383967 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45f5fa6f-e4b9-4034-9ffa-39aa7c23f87e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:46.384402 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-45f5fa6f-e4b9-4034-9ffa-39aa7c23f87e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:46.512174 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-45f5fa6f-e4b9-4034-9ffa-39aa7c23f87e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:46.520742 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-45f5fa6f-e4b9-4034-9ffa-39aa7c23f87e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:46.522960 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-45f5fa6f-e4b9-4034-9ffa-39aa7c23f87e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:46.524180 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-45f5fa6f-e4b9-4034-9ffa-39aa7c23f87e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.153352 Jul 14 12:22:46.524749 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 317/621] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:46 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:46.763580 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-da1c8e0b-d9a3-42eb-8ae7-580faeaaec0a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:46.764225 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-da1c8e0b-d9a3-42eb-8ae7-580faeaaec0a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:46.766201 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:46.771049 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da1c8e0b-d9a3-42eb-8ae7-580faeaaec0a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:46.771693 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da1c8e0b-d9a3-42eb-8ae7-580faeaaec0a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:46.773000 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da1c8e0b-d9a3-42eb-8ae7-580faeaaec0a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:46.773440 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-da1c8e0b-d9a3-42eb-8ae7-580faeaaec0a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:46.786530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-da1c8e0b-d9a3-42eb-8ae7-580faeaaec0a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] HTTP exception thrown: Instance 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 could not be found. Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-da1c8e0b-d9a3-42eb-8ae7-580faeaaec0a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Request method failure captured: Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 HTTP/1.1 Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0ApHzVXZTo1EgiCWTL1R0uUR7AAkn0Qkzas2aK0RaQBvX8rBWM8Y_F7o0EbJLq6yATTfzOTsPDLa2uvzkRWWL6bzvCFhtImSHRjymKL41i2PRWc7cMm4FG0Z_bL500zALjVH6kwaw9yDNT07X4enBj36KTeii856-CINhwL6ZPJgmlY Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: bae52c2cdf124894a541a6b7407eb23c Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-VolumesSnapshotTestJSON-742280967 Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:22:46.791573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bae52c2cdf124894a541a6b7407eb23c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bae52c2cdf124894a541a6b7407eb23c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bae52c2cdf124894a541a6b7407eb23c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bae52c2cdf124894a541a6b7407eb23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-VolumesSnapshotTestJSON-742280967 Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: bae52c2cdf124894a541a6b7407eb23c Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-742280967 Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-VolumesSnapshotTestJSON-742280967-project Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: ea504bdceb7b4a1b8109c658e133f955 Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-VolumesSnapshotTestJSON-742280967-project Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 could not be found. Jul 14 12:22:46.793196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '3bec056f-1ed7-4c1f-9e79-6f44c353d9c3'} Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 could not be found. Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:22:46.793998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 could not be found. Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 could not be found. Jul 14 12:22:46.795472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:22:46.797028 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-da1c8e0b-d9a3-42eb-8ae7-580faeaaec0a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Returning 404 to user: Instance 3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:22:46.797028 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-da1c8e0b-d9a3-42eb-8ae7-580faeaaec0a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3" status: 404 len: 111 microversion: 2.1 time: 0.030247 Jul 14 12:22:46.797028 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 305/622] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:46 2022] GET /compute/v2.1/servers/3bec056f-1ed7-4c1f-9e79-6f44c353d9c3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:22:47.538500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a336bc56-66a2-427e-83dc-7316535ebeac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d220846-5fa5-4e50-a7be-6501e3f67291"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:47.540211 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a336bc56-66a2-427e-83dc-7316535ebeac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:47.542979 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-580e661d-2076-4462-af0e-d08bd0ebf99c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:47.543590 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-580e661d-2076-4462-af0e-d08bd0ebf99c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:47.547053 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a336bc56-66a2-427e-83dc-7316535ebeac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:47.549868 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a336bc56-66a2-427e-83dc-7316535ebeac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:47.549868 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a336bc56-66a2-427e-83dc-7316535ebeac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:47.549868 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a336bc56-66a2-427e-83dc-7316535ebeac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:47.550120 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-580e661d-2076-4462-af0e-d08bd0ebf99c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:47.550527 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-580e661d-2076-4462-af0e-d08bd0ebf99c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:47.551313 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-580e661d-2076-4462-af0e-d08bd0ebf99c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:47.551749 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-580e661d-2076-4462-af0e-d08bd0ebf99c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:47.684834 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-580e661d-2076-4462-af0e-d08bd0ebf99c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:47.693356 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-580e661d-2076-4462-af0e-d08bd0ebf99c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:47.698832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-580e661d-2076-4462-af0e-d08bd0ebf99c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:47.698832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-580e661d-2076-4462-af0e-d08bd0ebf99c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.157904 Jul 14 12:22:47.698832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 306/623] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:47 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:22:48.713789 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-72b53217-ac68-4a06-8c99-bca4fd0d268d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:48.714446 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-72b53217-ac68-4a06-8c99-bca4fd0d268d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:48.720841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-72b53217-ac68-4a06-8c99-bca4fd0d268d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:48.721280 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-72b53217-ac68-4a06-8c99-bca4fd0d268d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:48.722037 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-72b53217-ac68-4a06-8c99-bca4fd0d268d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:48.722464 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-72b53217-ac68-4a06-8c99-bca4fd0d268d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:48.856306 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-72b53217-ac68-4a06-8c99-bca4fd0d268d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:48.864773 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-72b53217-ac68-4a06-8c99-bca4fd0d268d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:48.866273 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-72b53217-ac68-4a06-8c99-bca4fd0d268d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:48.867447 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-72b53217-ac68-4a06-8c99-bca4fd0d268d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.157562 Jul 14 12:22:48.868013 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 307/624] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:48 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:22:49.888672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-caca1503-e404-4c9a-a81b-db35ade0c93f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:49.889455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-caca1503-e404-4c9a-a81b-db35ade0c93f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:49.897424 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-caca1503-e404-4c9a-a81b-db35ade0c93f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:49.898117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-caca1503-e404-4c9a-a81b-db35ade0c93f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:49.899146 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-caca1503-e404-4c9a-a81b-db35ade0c93f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:49.899608 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-caca1503-e404-4c9a-a81b-db35ade0c93f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:50.051563 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-caca1503-e404-4c9a-a81b-db35ade0c93f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:50.060250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-caca1503-e404-4c9a-a81b-db35ade0c93f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:50.061746 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-caca1503-e404-4c9a-a81b-db35ade0c93f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:50.062976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-caca1503-e404-4c9a-a81b-db35ade0c93f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.181241 Jul 14 12:22:50.063535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 308/625] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:49 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:22:50.327312 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3e642b9b-4482-4473-9e19-15a8860e66a8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:50.328371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3e642b9b-4482-4473-9e19-15a8860e66a8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:50.334290 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e642b9b-4482-4473-9e19-15a8860e66a8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:50.340256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e642b9b-4482-4473-9e19-15a8860e66a8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:50.340256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e642b9b-4482-4473-9e19-15a8860e66a8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:50.340256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3e642b9b-4482-4473-9e19-15a8860e66a8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:50.565391 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3e642b9b-4482-4473-9e19-15a8860e66a8 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "POST /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/action" status: 202 len: 0 microversion: 2.1 time: 0.241858 Jul 14 12:22:50.566049 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 309/626] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:22:50 2022] POST /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 12:22:50.574104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e0aa115c-d200-42e0-8a68-e582224dc069 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:50.574822 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e0aa115c-d200-42e0-8a68-e582224dc069 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:50.580982 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e0aa115c-d200-42e0-8a68-e582224dc069 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:50.581432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e0aa115c-d200-42e0-8a68-e582224dc069 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:50.582202 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e0aa115c-d200-42e0-8a68-e582224dc069 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:50.582647 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e0aa115c-d200-42e0-8a68-e582224dc069 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:50.739982 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e0aa115c-d200-42e0-8a68-e582224dc069 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:50.745155 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e0aa115c-d200-42e0-8a68-e582224dc069 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1750 microversion: 2.1 time: 0.174795 Jul 14 12:22:50.745903 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 310/627] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:50 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1750 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:22:50.937937 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a336bc56-66a2-427e-83dc-7316535ebeac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.403674 Jul 14 12:22:50.938875 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 318/628] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:22:47 2022] POST /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments => generated 194 bytes in 3405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:22:51.081822 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c5774aa7-7afa-42cb-8961-1bdd882dc18d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:51.082562 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c5774aa7-7afa-42cb-8961-1bdd882dc18d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:51.089895 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c5774aa7-7afa-42cb-8961-1bdd882dc18d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:51.090342 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c5774aa7-7afa-42cb-8961-1bdd882dc18d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:51.091159 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c5774aa7-7afa-42cb-8961-1bdd882dc18d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:51.091594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c5774aa7-7afa-42cb-8961-1bdd882dc18d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:51.311384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c5774aa7-7afa-42cb-8961-1bdd882dc18d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:51.322198 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c5774aa7-7afa-42cb-8961-1bdd882dc18d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:51.323871 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c5774aa7-7afa-42cb-8961-1bdd882dc18d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:51.325219 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c5774aa7-7afa-42cb-8961-1bdd882dc18d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.247300 Jul 14 12:22:51.326154 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 311/629] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:51 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:51.763399 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-40bf82e4-05b0-4f6d-80f5-4920e2421ea1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:51.764084 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-40bf82e4-05b0-4f6d-80f5-4920e2421ea1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:51.766473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=34 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:51.772331 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40bf82e4-05b0-4f6d-80f5-4920e2421ea1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:51.772779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40bf82e4-05b0-4f6d-80f5-4920e2421ea1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:51.773548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40bf82e4-05b0-4f6d-80f5-4920e2421ea1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:51.774017 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40bf82e4-05b0-4f6d-80f5-4920e2421ea1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:51.926238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-40bf82e4-05b0-4f6d-80f5-4920e2421ea1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:51.934858 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-40bf82e4-05b0-4f6d-80f5-4920e2421ea1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.175634 Jul 14 12:22:51.935422 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 319/630] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:51 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:52.324698 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-4a2066f0-48f0-411f-bcea-5c558f6fafa0 req-2aefa893-b15e-4de2-bc64-0506085767b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88a179-83e5-4361-8948-8a2632512eaf", "name": "network-vif-plugged", "status": "completed", "tag": "0091e22f-2f09-4a5d-9bd6-143e3f69992b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:52.332984 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-4a2066f0-48f0-411f-bcea-5c558f6fafa0 req-2aefa893-b15e-4de2-bc64-0506085767b7 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:52.333425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-4a2066f0-48f0-411f-bcea-5c558f6fafa0 req-2aefa893-b15e-4de2-bc64-0506085767b7 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:52.343604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-36217dc8-0b94-4280-8088-afd120cf0366 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:52.346088 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-36217dc8-0b94-4280-8088-afd120cf0366 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:52.346335 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-4a2066f0-48f0-411f-bcea-5c558f6fafa0 req-2aefa893-b15e-4de2-bc64-0506085767b7 service nova] Creating event network-vif-plugged:0091e22f-2f09-4a5d-9bd6-143e3f69992b for instance 4d88a179-83e5-4361-8948-8a2632512eaf on hv-cinder-84890 Jul 14 12:22:52.351577 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-4a2066f0-48f0-411f-bcea-5c558f6fafa0 req-2aefa893-b15e-4de2-bc64-0506085767b7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030970 Jul 14 12:22:52.351807 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36217dc8-0b94-4280-8088-afd120cf0366 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:52.352174 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 312/631] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:22:52.352290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36217dc8-0b94-4280-8088-afd120cf0366 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:52.353101 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36217dc8-0b94-4280-8088-afd120cf0366 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:52.353619 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36217dc8-0b94-4280-8088-afd120cf0366 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:52.488236 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-36217dc8-0b94-4280-8088-afd120cf0366 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:52.497269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-36217dc8-0b94-4280-8088-afd120cf0366 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:52.498793 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-36217dc8-0b94-4280-8088-afd120cf0366 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:52.499980 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-36217dc8-0b94-4280-8088-afd120cf0366 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.160199 Jul 14 12:22:52.500543 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 320/632] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:52 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:22:52.953093 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-588033ff-2e3a-49c9-8291-b77c9e036639 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:52.953786 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-588033ff-2e3a-49c9-8291-b77c9e036639 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:52.960191 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-588033ff-2e3a-49c9-8291-b77c9e036639 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:52.963459 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-588033ff-2e3a-49c9-8291-b77c9e036639 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:52.963459 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-588033ff-2e3a-49c9-8291-b77c9e036639 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:52.963459 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-588033ff-2e3a-49c9-8291-b77c9e036639 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:53.125581 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-588033ff-2e3a-49c9-8291-b77c9e036639 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:53.134632 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-588033ff-2e3a-49c9-8291-b77c9e036639 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.185824 Jul 14 12:22:53.135257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 313/633] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:52 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:53.518658 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4ffa83cc-aef9-4cbe-bb59-c71453e2695b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:53.519303 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4ffa83cc-aef9-4cbe-bb59-c71453e2695b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:53.526629 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4ffa83cc-aef9-4cbe-bb59-c71453e2695b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:53.527121 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4ffa83cc-aef9-4cbe-bb59-c71453e2695b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:53.527893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4ffa83cc-aef9-4cbe-bb59-c71453e2695b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:53.528329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4ffa83cc-aef9-4cbe-bb59-c71453e2695b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:53.662985 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4ffa83cc-aef9-4cbe-bb59-c71453e2695b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:53.671584 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4ffa83cc-aef9-4cbe-bb59-c71453e2695b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:53.673095 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4ffa83cc-aef9-4cbe-bb59-c71453e2695b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:53.674240 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4ffa83cc-aef9-4cbe-bb59-c71453e2695b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.159689 Jul 14 12:22:53.674813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 321/634] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:53 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:54.152543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bc0cc85c-7b38-42bf-93dc-fbbd25fa2d69 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:54.153154 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-bc0cc85c-7b38-42bf-93dc-fbbd25fa2d69 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:54.159613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc0cc85c-7b38-42bf-93dc-fbbd25fa2d69 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:54.160082 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc0cc85c-7b38-42bf-93dc-fbbd25fa2d69 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:54.160831 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc0cc85c-7b38-42bf-93dc-fbbd25fa2d69 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:54.161257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc0cc85c-7b38-42bf-93dc-fbbd25fa2d69 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:54.304091 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bc0cc85c-7b38-42bf-93dc-fbbd25fa2d69 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:54.311954 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bc0cc85c-7b38-42bf-93dc-fbbd25fa2d69 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.163335 Jul 14 12:22:54.312541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 314/635] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:54 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:54.692309 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-dc5a78f1-141d-4a9c-a1c3-80e89b44ed91 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:54.692839 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-dc5a78f1-141d-4a9c-a1c3-80e89b44ed91 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:54.700722 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dc5a78f1-141d-4a9c-a1c3-80e89b44ed91 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:54.701162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dc5a78f1-141d-4a9c-a1c3-80e89b44ed91 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:54.701917 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dc5a78f1-141d-4a9c-a1c3-80e89b44ed91 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:54.702349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dc5a78f1-141d-4a9c-a1c3-80e89b44ed91 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:54.832928 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dc5a78f1-141d-4a9c-a1c3-80e89b44ed91 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:54.841599 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dc5a78f1-141d-4a9c-a1c3-80e89b44ed91 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:54.843158 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dc5a78f1-141d-4a9c-a1c3-80e89b44ed91 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:54.844385 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-dc5a78f1-141d-4a9c-a1c3-80e89b44ed91 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.155978 Jul 14 12:22:54.845053 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 322/636] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:54 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:55.329282 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-479c589f-f0d6-4284-a710-71a83b3b4c09 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:55.329817 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-479c589f-f0d6-4284-a710-71a83b3b4c09 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:55.336349 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-479c589f-f0d6-4284-a710-71a83b3b4c09 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:55.336789 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-479c589f-f0d6-4284-a710-71a83b3b4c09 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:55.337536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-479c589f-f0d6-4284-a710-71a83b3b4c09 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:55.337963 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-479c589f-f0d6-4284-a710-71a83b3b4c09 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:55.476374 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-479c589f-f0d6-4284-a710-71a83b3b4c09 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:55.484416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-479c589f-f0d6-4284-a710-71a83b3b4c09 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.158962 Jul 14 12:22:55.485019 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 315/637] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:55 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:55.862721 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1b72fde4-313f-4736-87d9-0949943d6acd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:55.863356 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1b72fde4-313f-4736-87d9-0949943d6acd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:55.870351 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1b72fde4-313f-4736-87d9-0949943d6acd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:55.870842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1b72fde4-313f-4736-87d9-0949943d6acd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:55.871618 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1b72fde4-313f-4736-87d9-0949943d6acd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:55.872057 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1b72fde4-313f-4736-87d9-0949943d6acd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:56.004601 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1b72fde4-313f-4736-87d9-0949943d6acd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:56.013952 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1b72fde4-313f-4736-87d9-0949943d6acd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:56.015506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1b72fde4-313f-4736-87d9-0949943d6acd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:56.016632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1b72fde4-313f-4736-87d9-0949943d6acd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.157806 Jul 14 12:22:56.017200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 323/638] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:55 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:56.501654 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-41a82eec-515f-451a-a396-d070f00920e1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:56.502260 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-41a82eec-515f-451a-a396-d070f00920e1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:56.509493 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41a82eec-515f-451a-a396-d070f00920e1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:56.509875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41a82eec-515f-451a-a396-d070f00920e1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:56.510630 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41a82eec-515f-451a-a396-d070f00920e1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:56.511099 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41a82eec-515f-451a-a396-d070f00920e1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:56.655283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-41a82eec-515f-451a-a396-d070f00920e1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:56.663153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-41a82eec-515f-451a-a396-d070f00920e1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.165264 Jul 14 12:22:56.663723 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 316/639] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:56 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:57.035168 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-747e5268-4edf-4247-ab7c-ccf57fdac4e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:57.035778 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-747e5268-4edf-4247-ab7c-ccf57fdac4e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:57.043073 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-747e5268-4edf-4247-ab7c-ccf57fdac4e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:57.043522 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-747e5268-4edf-4247-ab7c-ccf57fdac4e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:57.044282 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-747e5268-4edf-4247-ab7c-ccf57fdac4e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:57.044717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-747e5268-4edf-4247-ab7c-ccf57fdac4e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:57.176567 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-747e5268-4edf-4247-ab7c-ccf57fdac4e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:57.185465 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-747e5268-4edf-4247-ab7c-ccf57fdac4e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:57.187031 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-747e5268-4edf-4247-ab7c-ccf57fdac4e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:57.188165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-747e5268-4edf-4247-ab7c-ccf57fdac4e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.156882 Jul 14 12:22:57.189601 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 324/640] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:57 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:57.238950 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1113911617", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "networks": [{"uuid": "b7c77089-f3cd-4ab0-9a84-cc1746e2d34c"}]}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:57.293418 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] validate_networks() for [('b7c77089-f3cd-4ab0-9a84-cc1746e2d34c', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:22:57.647628 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:22:57.650620 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:22:57.650620 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:22:57.650620 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:22:57.650620 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:22:57.659871 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:57.660437 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:57.661416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:57.661863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:57.680520 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f843edb9-e562-4a1b-8eea-8b29383fdf03 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:57.680712 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Getting quotas for project bae52c2cdf124894a541a6b7407eb23c. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:22:57.681129 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f843edb9-e562-4a1b-8eea-8b29383fdf03 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:57.684750 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Getting quotas for user ea504bdceb7b4a1b8109c658e133f955 and project bae52c2cdf124894a541a6b7407eb23c. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:22:57.687098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f843edb9-e562-4a1b-8eea-8b29383fdf03 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:57.696646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f843edb9-e562-4a1b-8eea-8b29383fdf03 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:57.696646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f843edb9-e562-4a1b-8eea-8b29383fdf03 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:57.696646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f843edb9-e562-4a1b-8eea-8b29383fdf03 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:57.697015 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:22:57.698698 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:22:57.820956 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-1f33532b-6761-454d-aee2-d17878c4f7f1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585659 Jul 14 12:22:57.821526 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 317/641] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:22:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:22:57.832397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7093093a-c4be-46a2-86f9-a0d1d7760ef1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:57.833290 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7093093a-c4be-46a2-86f9-a0d1d7760ef1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:57.838647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f843edb9-e562-4a1b-8eea-8b29383fdf03 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:57.842328 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:57.854999 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f843edb9-e562-4a1b-8eea-8b29383fdf03 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.178309 Jul 14 12:22:57.856345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 325/642] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:57 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:22:57.898433 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7093093a-c4be-46a2-86f9-a0d1d7760ef1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:57.905147 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7093093a-c4be-46a2-86f9-a0d1d7760ef1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1219 microversion: 2.1 time: 0.077347 Jul 14 12:22:57.905715 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 318/643] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:57 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1219 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:58.205892 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ed97f9c4-d9e7-4c14-a576-780bd850d669 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:58.206639 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ed97f9c4-d9e7-4c14-a576-780bd850d669 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:58.216369 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ed97f9c4-d9e7-4c14-a576-780bd850d669 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:58.216899 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ed97f9c4-d9e7-4c14-a576-780bd850d669 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:58.217806 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ed97f9c4-d9e7-4c14-a576-780bd850d669 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:58.218260 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ed97f9c4-d9e7-4c14-a576-780bd850d669 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:58.370911 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ed97f9c4-d9e7-4c14-a576-780bd850d669 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:58.381654 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ed97f9c4-d9e7-4c14-a576-780bd850d669 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:58.383326 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ed97f9c4-d9e7-4c14-a576-780bd850d669 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:58.384597 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ed97f9c4-d9e7-4c14-a576-780bd850d669 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1806 microversion: 2.20 time: 0.182914 Jul 14 12:22:58.385153 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 326/644] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:58 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1806 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:58.873747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3efc2f2a-1be1-4cb3-b301-f51017598861 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:58.874350 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3efc2f2a-1be1-4cb3-b301-f51017598861 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:58.882882 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3efc2f2a-1be1-4cb3-b301-f51017598861 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:58.883357 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3efc2f2a-1be1-4cb3-b301-f51017598861 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:58.884127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3efc2f2a-1be1-4cb3-b301-f51017598861 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:58.884564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3efc2f2a-1be1-4cb3-b301-f51017598861 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:58.888934 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:22:58.923022 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8adc431c-56db-4b39-9bde-70130a0769d4 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:58.923707 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8adc431c-56db-4b39-9bde-70130a0769d4 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:58.930536 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8adc431c-56db-4b39-9bde-70130a0769d4 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:58.931146 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8adc431c-56db-4b39-9bde-70130a0769d4 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:58.931977 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8adc431c-56db-4b39-9bde-70130a0769d4 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:58.932475 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8adc431c-56db-4b39-9bde-70130a0769d4 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:58.995124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8adc431c-56db-4b39-9bde-70130a0769d4 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:59.002634 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8adc431c-56db-4b39-9bde-70130a0769d4 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1223 microversion: 2.1 time: 0.083782 Jul 14 12:22:59.003267 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 327/645] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:58 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:22:59.030989 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3efc2f2a-1be1-4cb3-b301-f51017598861 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:59.038754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3efc2f2a-1be1-4cb3-b301-f51017598861 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.169110 Jul 14 12:22:59.039335 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 319/646] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:58 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:22:59.403071 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-dfe6dd98-0687-456d-8382-28693b02aaa4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:59.403712 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-dfe6dd98-0687-456d-8382-28693b02aaa4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:59.411018 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dfe6dd98-0687-456d-8382-28693b02aaa4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:59.411463 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dfe6dd98-0687-456d-8382-28693b02aaa4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:59.412795 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dfe6dd98-0687-456d-8382-28693b02aaa4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:59.413395 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dfe6dd98-0687-456d-8382-28693b02aaa4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:59.508612 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2b66126d-8f25-460d-a795-ad7051a6a096 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:22:59.509701 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2b66126d-8f25-460d-a795-ad7051a6a096 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:59.516609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2b66126d-8f25-460d-a795-ad7051a6a096 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:59.520118 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2b66126d-8f25-460d-a795-ad7051a6a096 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:59.520118 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2b66126d-8f25-460d-a795-ad7051a6a096 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:59.520118 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2b66126d-8f25-460d-a795-ad7051a6a096 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:59.541571 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-2b66126d-8f25-460d-a795-ad7051a6a096 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lazy-loading 'flavor' on Instance uuid 158005c6-a074-4abf-a8b8-7c1ee3250b2e {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:22:59.550103 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dfe6dd98-0687-456d-8382-28693b02aaa4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:59.560450 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dfe6dd98-0687-456d-8382-28693b02aaa4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:59.562014 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dfe6dd98-0687-456d-8382-28693b02aaa4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:59.563196 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-dfe6dd98-0687-456d-8382-28693b02aaa4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1793 microversion: 2.20 time: 0.164128 Jul 14 12:22:59.564051 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 328/647] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:22:59 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1793 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:22:59.806672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2b66126d-8f25-460d-a795-ad7051a6a096 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/action" status: 200 len: 32 microversion: 2.1 time: 0.302885 Jul 14 12:22:59.807207 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 320/648] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:22:59 2022] POST /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/action => generated 32 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 12:22:59.816037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1b76a7df-442a-4f1e-b1a1-c9992fca49c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:22:59.816669 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1b76a7df-442a-4f1e-b1a1-c9992fca49c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:22:59.822864 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1b76a7df-442a-4f1e-b1a1-c9992fca49c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:59.823315 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1b76a7df-442a-4f1e-b1a1-c9992fca49c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:59.824071 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1b76a7df-442a-4f1e-b1a1-c9992fca49c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:22:59.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1b76a7df-442a-4f1e-b1a1-c9992fca49c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:22:59.956378 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1b76a7df-442a-4f1e-b1a1-c9992fca49c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:22:59.966094 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1b76a7df-442a-4f1e-b1a1-c9992fca49c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.153793 Jul 14 12:22:59.967621 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 329/649] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:22:59 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:00.020935 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ad5f65ac-cd92-4392-bbd4-037df6251f9f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:00.022332 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ad5f65ac-cd92-4392-bbd4-037df6251f9f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:00.028674 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ad5f65ac-cd92-4392-bbd4-037df6251f9f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:00.029310 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ad5f65ac-cd92-4392-bbd4-037df6251f9f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:00.030113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ad5f65ac-cd92-4392-bbd4-037df6251f9f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:00.030553 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ad5f65ac-cd92-4392-bbd4-037df6251f9f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:00.055957 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ccdddfa6-c356-46f7-8af5-4aa9f0deba2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:00.056643 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ccdddfa6-c356-46f7-8af5-4aa9f0deba2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:00.063265 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ccdddfa6-c356-46f7-8af5-4aa9f0deba2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:00.064241 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ccdddfa6-c356-46f7-8af5-4aa9f0deba2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:00.065058 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ccdddfa6-c356-46f7-8af5-4aa9f0deba2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:00.065491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ccdddfa6-c356-46f7-8af5-4aa9f0deba2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:00.102481 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ad5f65ac-cd92-4392-bbd4-037df6251f9f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:00.111150 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ad5f65ac-cd92-4392-bbd4-037df6251f9f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1271 microversion: 2.1 time: 0.094995 Jul 14 12:23:00.121172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 321/650] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:00 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1271 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:00.215120 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ccdddfa6-c356-46f7-8af5-4aa9f0deba2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:00.223386 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ccdddfa6-c356-46f7-8af5-4aa9f0deba2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.171403 Jul 14 12:23:00.224030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 330/651] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:00 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:00.984212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e00d30b2-7f37-4b5d-9218-c5509aa2abfc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:00.984779 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e00d30b2-7f37-4b5d-9218-c5509aa2abfc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:00.991203 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e00d30b2-7f37-4b5d-9218-c5509aa2abfc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:00.991721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e00d30b2-7f37-4b5d-9218-c5509aa2abfc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:00.992550 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e00d30b2-7f37-4b5d-9218-c5509aa2abfc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:00.993045 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e00d30b2-7f37-4b5d-9218-c5509aa2abfc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:01.128326 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-dc40c746-e8d0-429c-85a6-e400a7ba2b11 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:01.129081 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-dc40c746-e8d0-429c-85a6-e400a7ba2b11 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:01.135674 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dc40c746-e8d0-429c-85a6-e400a7ba2b11 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:01.136128 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dc40c746-e8d0-429c-85a6-e400a7ba2b11 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:01.136909 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dc40c746-e8d0-429c-85a6-e400a7ba2b11 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:01.137342 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dc40c746-e8d0-429c-85a6-e400a7ba2b11 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:01.224216 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e00d30b2-7f37-4b5d-9218-c5509aa2abfc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:01.233252 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e00d30b2-7f37-4b5d-9218-c5509aa2abfc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.252852 Jul 14 12:23:01.233851 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 322/652] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:00 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:01.240723 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-72b5328f-0a4b-4414-9120-5234af2711fa tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:01.241286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-72b5328f-0a4b-4414-9120-5234af2711fa tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:01.247818 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-72b5328f-0a4b-4414-9120-5234af2711fa tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:01.248339 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-72b5328f-0a4b-4414-9120-5234af2711fa tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:01.249201 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-72b5328f-0a4b-4414-9120-5234af2711fa tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:01.249701 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-72b5328f-0a4b-4414-9120-5234af2711fa tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:01.273983 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dc40c746-e8d0-429c-85a6-e400a7ba2b11 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:01.282033 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-dc40c746-e8d0-429c-85a6-e400a7ba2b11 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1319 microversion: 2.1 time: 0.157510 Jul 14 12:23:01.282618 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 331/653] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:01 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:01.474730 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-72b5328f-0a4b-4414-9120-5234af2711fa tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:01.482841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-72b5328f-0a4b-4414-9120-5234af2711fa tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.245870 Jul 14 12:23:01.483707 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 323/654] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:01 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:02.249776 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6da3b36b-286e-4f03-b0f7-6be4a434feca tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:02.250339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6da3b36b-286e-4f03-b0f7-6be4a434feca tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:02.257665 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6da3b36b-286e-4f03-b0f7-6be4a434feca tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:02.257941 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6da3b36b-286e-4f03-b0f7-6be4a434feca tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:02.258702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6da3b36b-286e-4f03-b0f7-6be4a434feca tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:02.259158 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6da3b36b-286e-4f03-b0f7-6be4a434feca tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:02.299915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5f25a9af-2d50-45c9-b83c-4c31d650f86d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:02.301159 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5f25a9af-2d50-45c9-b83c-4c31d650f86d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:02.308805 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5f25a9af-2d50-45c9-b83c-4c31d650f86d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:02.309169 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5f25a9af-2d50-45c9-b83c-4c31d650f86d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:02.309832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5f25a9af-2d50-45c9-b83c-4c31d650f86d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:02.310264 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5f25a9af-2d50-45c9-b83c-4c31d650f86d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:02.403097 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6da3b36b-286e-4f03-b0f7-6be4a434feca tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:02.411439 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6da3b36b-286e-4f03-b0f7-6be4a434feca tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.165563 Jul 14 12:23:02.421726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 332/655] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:02 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:02.421726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-ff232757-99bf-4d22-b224-c61fa8e690b0 req-8ecc9b5d-cae6-46b4-ba44-bfb46ed946aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5c5780a-6bcf-4be9-8453-318344d781a6", "tag": "c1af4606-a701-43c3-aa36-d3dd1c16d806"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:02.426932 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-ff232757-99bf-4d22-b224-c61fa8e690b0 req-8ecc9b5d-cae6-46b4-ba44-bfb46ed946aa service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:02.427472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-ff232757-99bf-4d22-b224-c61fa8e690b0 req-8ecc9b5d-cae6-46b4-ba44-bfb46ed946aa service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:02.440127 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-ff232757-99bf-4d22-b224-c61fa8e690b0 req-8ecc9b5d-cae6-46b4-ba44-bfb46ed946aa service nova] Creating event network-changed:c1af4606-a701-43c3-aa36-d3dd1c16d806 for instance a5c5780a-6bcf-4be9-8453-318344d781a6 on hv-cinder-84890 Jul 14 12:23:02.445564 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-ff232757-99bf-4d22-b224-c61fa8e690b0 req-8ecc9b5d-cae6-46b4-ba44-bfb46ed946aa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032028 Jul 14 12:23:02.446374 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 333/656] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:02.481843 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5f25a9af-2d50-45c9-b83c-4c31d650f86d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:02.490574 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5f25a9af-2d50-45c9-b83c-4c31d650f86d tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1319 microversion: 2.1 time: 0.193903 Jul 14 12:23:02.490574 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 324/657] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:02 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:02.501506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-50fe0aea-258b-447c-a7d7-afd95d357978 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:02.502212 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-50fe0aea-258b-447c-a7d7-afd95d357978 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:02.509149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-50fe0aea-258b-447c-a7d7-afd95d357978 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:02.509604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-50fe0aea-258b-447c-a7d7-afd95d357978 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:02.510370 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-50fe0aea-258b-447c-a7d7-afd95d357978 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:02.510832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-50fe0aea-258b-447c-a7d7-afd95d357978 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:02.655181 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-50fe0aea-258b-447c-a7d7-afd95d357978 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:02.663441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-50fe0aea-258b-447c-a7d7-afd95d357978 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.166173 Jul 14 12:23:02.664102 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 334/658] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:02 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:03.428946 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e1d3ded6-8da7-48a1-b382-74226947abae tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:03.429599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e1d3ded6-8da7-48a1-b382-74226947abae tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:03.436085 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e1d3ded6-8da7-48a1-b382-74226947abae tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:03.436533 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e1d3ded6-8da7-48a1-b382-74226947abae tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:03.437286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e1d3ded6-8da7-48a1-b382-74226947abae tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:03.437720 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e1d3ded6-8da7-48a1-b382-74226947abae tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:03.505530 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-542f5479-cf3c-4f2a-b137-1f58532f1b8e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:03.506324 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-542f5479-cf3c-4f2a-b137-1f58532f1b8e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:03.512599 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-542f5479-cf3c-4f2a-b137-1f58532f1b8e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:03.513038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-542f5479-cf3c-4f2a-b137-1f58532f1b8e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:03.513790 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-542f5479-cf3c-4f2a-b137-1f58532f1b8e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:03.514215 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-542f5479-cf3c-4f2a-b137-1f58532f1b8e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:03.573799 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e1d3ded6-8da7-48a1-b382-74226947abae tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:03.581904 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e1d3ded6-8da7-48a1-b382-74226947abae tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.156860 Jul 14 12:23:03.582562 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 325/659] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:03 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:03.647810 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-542f5479-cf3c-4f2a-b137-1f58532f1b8e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:03.655234 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-542f5479-cf3c-4f2a-b137-1f58532f1b8e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1319 microversion: 2.1 time: 0.153523 Jul 14 12:23:03.655802 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 335/660] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:03 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:03.681444 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b7fb8797-27e4-4ebb-b120-b17beb508958 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:03.682020 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b7fb8797-27e4-4ebb-b120-b17beb508958 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:03.688040 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b7fb8797-27e4-4ebb-b120-b17beb508958 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:03.688491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b7fb8797-27e4-4ebb-b120-b17beb508958 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:03.689255 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b7fb8797-27e4-4ebb-b120-b17beb508958 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:03.689706 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b7fb8797-27e4-4ebb-b120-b17beb508958 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:03.828318 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b7fb8797-27e4-4ebb-b120-b17beb508958 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:03.836440 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b7fb8797-27e4-4ebb-b120-b17beb508958 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.159465 Jul 14 12:23:03.837001 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 326/661] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:03 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:04.600788 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-59822e75-d1f5-4846-a57e-1464bea8ae8e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:04.601415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-59822e75-d1f5-4846-a57e-1464bea8ae8e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:04.607898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-59822e75-d1f5-4846-a57e-1464bea8ae8e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:04.608345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-59822e75-d1f5-4846-a57e-1464bea8ae8e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:04.609111 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-59822e75-d1f5-4846-a57e-1464bea8ae8e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:04.609550 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-59822e75-d1f5-4846-a57e-1464bea8ae8e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:04.672650 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-6ef74274-92e8-4ab5-b4d0-6730cb5739f2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:04.673265 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-6ef74274-92e8-4ab5-b4d0-6730cb5739f2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:04.680857 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6ef74274-92e8-4ab5-b4d0-6730cb5739f2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:04.681338 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6ef74274-92e8-4ab5-b4d0-6730cb5739f2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:04.682323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6ef74274-92e8-4ab5-b4d0-6730cb5739f2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:04.682790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6ef74274-92e8-4ab5-b4d0-6730cb5739f2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:04.738037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-59822e75-d1f5-4846-a57e-1464bea8ae8e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:04.746859 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-59822e75-d1f5-4846-a57e-1464bea8ae8e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.150709 Jul 14 12:23:04.747435 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 336/662] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:04 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:04.814973 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6ef74274-92e8-4ab5-b4d0-6730cb5739f2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:04.822492 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-6ef74274-92e8-4ab5-b4d0-6730cb5739f2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1319 microversion: 2.1 time: 0.153918 Jul 14 12:23:04.823197 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 327/663] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:04 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:04.854195 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0bbc80fb-5766-4e6c-bbb7-00742f294b2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:04.854851 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0bbc80fb-5766-4e6c-bbb7-00742f294b2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:04.860850 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0bbc80fb-5766-4e6c-bbb7-00742f294b2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:04.861298 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0bbc80fb-5766-4e6c-bbb7-00742f294b2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:04.862056 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0bbc80fb-5766-4e6c-bbb7-00742f294b2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:04.862488 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0bbc80fb-5766-4e6c-bbb7-00742f294b2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.010741 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0bbc80fb-5766-4e6c-bbb7-00742f294b2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:05.018896 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0bbc80fb-5766-4e6c-bbb7-00742f294b2a tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.168493 Jul 14 12:23:05.019464 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 337/664] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:04 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:05.299591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-93f0c0df-7bd3-4031-95a7-7e9c084dfc3b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:05.300609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-93f0c0df-7bd3-4031-95a7-7e9c084dfc3b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:05.306703 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-93f0c0df-7bd3-4031-95a7-7e9c084dfc3b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:05.307185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-93f0c0df-7bd3-4031-95a7-7e9c084dfc3b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.307963 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-93f0c0df-7bd3-4031-95a7-7e9c084dfc3b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:05.308392 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-93f0c0df-7bd3-4031-95a7-7e9c084dfc3b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.336771 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-93f0c0df-7bd3-4031-95a7-7e9c084dfc3b tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041273 Jul 14 12:23:05.337308 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 328/665] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:23:05 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 12:23:05.392832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b2830276-7192-404d-9a44-8a80beaad241 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:05.393327 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b2830276-7192-404d-9a44-8a80beaad241 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:05.399999 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2830276-7192-404d-9a44-8a80beaad241 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:05.400447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2830276-7192-404d-9a44-8a80beaad241 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.401217 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2830276-7192-404d-9a44-8a80beaad241 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:05.401649 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2830276-7192-404d-9a44-8a80beaad241 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.425446 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b2830276-7192-404d-9a44-8a80beaad241 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:23:05.709228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b2830276-7192-404d-9a44-8a80beaad241 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 204 len: 0 microversion: 2.1 time: 0.319851 Jul 14 12:23:05.709919 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 338/666] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:23:05 2022] DELETE /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:23:05.718082 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0bebd1f1-9812-4a99-924e-dcb881dee2a5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:05.718846 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0bebd1f1-9812-4a99-924e-dcb881dee2a5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:05.725543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0bebd1f1-9812-4a99-924e-dcb881dee2a5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:05.725998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0bebd1f1-9812-4a99-924e-dcb881dee2a5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.726863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0bebd1f1-9812-4a99-924e-dcb881dee2a5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:05.727312 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0bebd1f1-9812-4a99-924e-dcb881dee2a5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.765183 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-67f2469d-a571-4a12-807a-3c611853bd37 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:05.765874 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-67f2469d-a571-4a12-807a-3c611853bd37 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:05.772126 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-67f2469d-a571-4a12-807a-3c611853bd37 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:05.772574 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-67f2469d-a571-4a12-807a-3c611853bd37 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.773355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-67f2469d-a571-4a12-807a-3c611853bd37 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:05.773794 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-67f2469d-a571-4a12-807a-3c611853bd37 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.863070 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0bebd1f1-9812-4a99-924e-dcb881dee2a5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:05.872258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0bebd1f1-9812-4a99-924e-dcb881dee2a5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1670 microversion: 2.1 time: 0.157968 Jul 14 12:23:05.872844 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 329/667] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:05 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:05.877413 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-82679f53-0ed2-4e92-8cb3-1e9f2f2ab4b2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:05.878003 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-82679f53-0ed2-4e92-8cb3-1e9f2f2ab4b2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:05.887273 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82679f53-0ed2-4e92-8cb3-1e9f2f2ab4b2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:05.887714 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82679f53-0ed2-4e92-8cb3-1e9f2f2ab4b2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.888472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82679f53-0ed2-4e92-8cb3-1e9f2f2ab4b2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:05.888900 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-82679f53-0ed2-4e92-8cb3-1e9f2f2ab4b2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:05.909915 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-67f2469d-a571-4a12-807a-3c611853bd37 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:05.918741 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-67f2469d-a571-4a12-807a-3c611853bd37 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.157733 Jul 14 12:23:05.919338 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 339/668] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:05 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:06.018456 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-82679f53-0ed2-4e92-8cb3-1e9f2f2ab4b2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:06.026347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-82679f53-0ed2-4e92-8cb3-1e9f2f2ab4b2 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1319 microversion: 2.1 time: 0.152408 Jul 14 12:23:06.026923 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 330/669] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:05 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:06.037548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5bc8587c-0c69-498c-9054-f3b6202a4360 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:06.038172 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5bc8587c-0c69-498c-9054-f3b6202a4360 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:06.044054 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5bc8587c-0c69-498c-9054-f3b6202a4360 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:06.044497 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5bc8587c-0c69-498c-9054-f3b6202a4360 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:06.045503 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5bc8587c-0c69-498c-9054-f3b6202a4360 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:06.045931 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5bc8587c-0c69-498c-9054-f3b6202a4360 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:06.183541 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5bc8587c-0c69-498c-9054-f3b6202a4360 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:06.191494 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5bc8587c-0c69-498c-9054-f3b6202a4360 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.158243 Jul 14 12:23:06.192068 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 340/670] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:06 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:06.890286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b7a3243b-163e-4fda-9310-28d5fd03f092 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:06.891005 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b7a3243b-163e-4fda-9310-28d5fd03f092 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:06.897793 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b7a3243b-163e-4fda-9310-28d5fd03f092 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:06.898242 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b7a3243b-163e-4fda-9310-28d5fd03f092 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:06.899053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b7a3243b-163e-4fda-9310-28d5fd03f092 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:06.899499 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b7a3243b-163e-4fda-9310-28d5fd03f092 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:06.936289 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e9d0f521-8e11-40b6-97e0-21eb4bbf0d7f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:06.936898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e9d0f521-8e11-40b6-97e0-21eb4bbf0d7f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:06.943667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9d0f521-8e11-40b6-97e0-21eb4bbf0d7f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:06.944202 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9d0f521-8e11-40b6-97e0-21eb4bbf0d7f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:06.945186 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9d0f521-8e11-40b6-97e0-21eb4bbf0d7f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:06.945684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e9d0f521-8e11-40b6-97e0-21eb4bbf0d7f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:06.966478 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:07.050623 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b7a3243b-163e-4fda-9310-28d5fd03f092 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:07.059041 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b7a3243b-163e-4fda-9310-28d5fd03f092 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1670 microversion: 2.1 time: 0.172482 Jul 14 12:23:07.059630 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 331/671] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:06 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:07.064300 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3fc338b6-032c-4673-a25d-95111e3dfa31 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:07.064902 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3fc338b6-032c-4673-a25d-95111e3dfa31 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:07.071174 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3fc338b6-032c-4673-a25d-95111e3dfa31 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:07.071599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3fc338b6-032c-4673-a25d-95111e3dfa31 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:07.072364 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3fc338b6-032c-4673-a25d-95111e3dfa31 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:07.072788 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3fc338b6-032c-4673-a25d-95111e3dfa31 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:07.214923 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3fc338b6-032c-4673-a25d-95111e3dfa31 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:07.222676 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3fc338b6-032c-4673-a25d-95111e3dfa31 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1319 microversion: 2.1 time: 0.161918 Jul 14 12:23:07.223282 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 332/672] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:07 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:07.228836 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-224f9678-912b-48a1-b04f-5eaa0af89902 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:07.228836 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-224f9678-912b-48a1-b04f-5eaa0af89902 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:07.235029 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-224f9678-912b-48a1-b04f-5eaa0af89902 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:07.235485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-224f9678-912b-48a1-b04f-5eaa0af89902 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:07.236265 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-224f9678-912b-48a1-b04f-5eaa0af89902 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:07.236704 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-224f9678-912b-48a1-b04f-5eaa0af89902 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:07.298636 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e9d0f521-8e11-40b6-97e0-21eb4bbf0d7f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:07.306595 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e9d0f521-8e11-40b6-97e0-21eb4bbf0d7f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.374212 Jul 14 12:23:07.307305 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 341/673] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:06 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:07.377937 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-224f9678-912b-48a1-b04f-5eaa0af89902 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:07.381451 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:07.386282 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-224f9678-912b-48a1-b04f-5eaa0af89902 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.162028 Jul 14 12:23:07.386861 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 333/674] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:07 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:08.076613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-36a2d3f3-43ff-4968-9d41-68d0cf6e6d15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:08.077230 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-36a2d3f3-43ff-4968-9d41-68d0cf6e6d15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:08.083733 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36a2d3f3-43ff-4968-9d41-68d0cf6e6d15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:08.084184 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36a2d3f3-43ff-4968-9d41-68d0cf6e6d15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:08.084953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36a2d3f3-43ff-4968-9d41-68d0cf6e6d15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:08.085391 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36a2d3f3-43ff-4968-9d41-68d0cf6e6d15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:08.215800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-36a2d3f3-43ff-4968-9d41-68d0cf6e6d15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:08.223382 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-36a2d3f3-43ff-4968-9d41-68d0cf6e6d15 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1670 microversion: 2.1 time: 0.150848 Jul 14 12:23:08.224491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 342/675] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:08 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:08.247498 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-65f6bb5d-818c-4be3-a417-31cba20707b7 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:08.248118 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-65f6bb5d-818c-4be3-a417-31cba20707b7 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:08.250015 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:08.252901 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=8 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:08.256339 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-65f6bb5d-818c-4be3-a417-31cba20707b7 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:08.256887 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-65f6bb5d-818c-4be3-a417-31cba20707b7 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:08.257737 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-65f6bb5d-818c-4be3-a417-31cba20707b7 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:08.258304 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-65f6bb5d-818c-4be3-a417-31cba20707b7 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:08.323871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cb673703-0d68-47be-9aba-fae1b940b6fe tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:08.324657 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-cb673703-0d68-47be-9aba-fae1b940b6fe tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:08.331191 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb673703-0d68-47be-9aba-fae1b940b6fe tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:08.331650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb673703-0d68-47be-9aba-fae1b940b6fe tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:08.332420 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb673703-0d68-47be-9aba-fae1b940b6fe tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:08.332861 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb673703-0d68-47be-9aba-fae1b940b6fe tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:08.491943 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-cb673703-0d68-47be-9aba-fae1b940b6fe tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:08.500352 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cb673703-0d68-47be-9aba-fae1b940b6fe tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.180414 Jul 14 12:23:08.500962 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 343/676] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:08 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:08.514943 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-427f83f4-f88b-4794-b685-f55a21a02352 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:08.515561 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-427f83f4-f88b-4794-b685-f55a21a02352 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:08.521782 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-427f83f4-f88b-4794-b685-f55a21a02352 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:08.522238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-427f83f4-f88b-4794-b685-f55a21a02352 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:08.523054 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-427f83f4-f88b-4794-b685-f55a21a02352 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:08.523662 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-427f83f4-f88b-4794-b685-f55a21a02352 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:08.548317 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-65f6bb5d-818c-4be3-a417-31cba20707b7 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:08.563233 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-65f6bb5d-818c-4be3-a417-31cba20707b7 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1319 microversion: 2.1 time: 0.327008 Jul 14 12:23:08.565080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 334/677] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:08 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1319 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:08.570010 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-f04bf122-d311-4186-92de-d570eaa095a4 req-a0a0f876-682d-4f7b-9eb8-33cb987757cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c5780a-6bcf-4be9-8453-318344d781a6", "name": "network-vif-plugged", "status": "completed", "tag": "c1af4606-a701-43c3-aa36-d3dd1c16d806"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:08.578171 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-f04bf122-d311-4186-92de-d570eaa095a4 req-a0a0f876-682d-4f7b-9eb8-33cb987757cf service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:08.578864 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-f04bf122-d311-4186-92de-d570eaa095a4 req-a0a0f876-682d-4f7b-9eb8-33cb987757cf service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:08.591559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-f04bf122-d311-4186-92de-d570eaa095a4 req-a0a0f876-682d-4f7b-9eb8-33cb987757cf service nova] Creating event network-vif-plugged:c1af4606-a701-43c3-aa36-d3dd1c16d806 for instance a5c5780a-6bcf-4be9-8453-318344d781a6 on hv-cinder-84890 Jul 14 12:23:08.596689 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-f04bf122-d311-4186-92de-d570eaa095a4 req-a0a0f876-682d-4f7b-9eb8-33cb987757cf service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030311 Jul 14 12:23:08.597286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 335/678] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:08.684459 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-427f83f4-f88b-4794-b685-f55a21a02352 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:08.693096 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-427f83f4-f88b-4794-b685-f55a21a02352 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1755 microversion: 2.1 time: 0.191027 Jul 14 12:23:08.693724 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 344/679] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:08 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:09.085636 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-436d3060-7ad8-44a8-be7b-1aaf2795d8ed req-eb133aa8-994a-48cc-ac15-afeed42d1481 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2634876-d37b-4436-9c61-23c72f9be7f0", "name": "network-vif-deleted", "tag": "eb0f6ace-e868-4677-b659-dfad15db6256"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:09.094847 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-436d3060-7ad8-44a8-be7b-1aaf2795d8ed req-eb133aa8-994a-48cc-ac15-afeed42d1481 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:09.095540 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-436d3060-7ad8-44a8-be7b-1aaf2795d8ed req-eb133aa8-994a-48cc-ac15-afeed42d1481 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:09.109558 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-436d3060-7ad8-44a8-be7b-1aaf2795d8ed req-eb133aa8-994a-48cc-ac15-afeed42d1481 service nova] Creating event network-vif-deleted:eb0f6ace-e868-4677-b659-dfad15db6256 for instance d2634876-d37b-4436-9c61-23c72f9be7f0 on hv-cinder-84890 Jul 14 12:23:09.114943 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-436d3060-7ad8-44a8-be7b-1aaf2795d8ed req-eb133aa8-994a-48cc-ac15-afeed42d1481 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034667 Jul 14 12:23:09.115558 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 336/680] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:09.241043 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cee6a9a0-9e22-415b-b6b0-adc3eef2b480 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:09.241864 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-cee6a9a0-9e22-415b-b6b0-adc3eef2b480 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:09.249069 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cee6a9a0-9e22-415b-b6b0-adc3eef2b480 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:09.249750 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cee6a9a0-9e22-415b-b6b0-adc3eef2b480 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:09.250743 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cee6a9a0-9e22-415b-b6b0-adc3eef2b480 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:09.251416 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cee6a9a0-9e22-415b-b6b0-adc3eef2b480 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:09.319972 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-cee6a9a0-9e22-415b-b6b0-adc3eef2b480 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:09.328228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cee6a9a0-9e22-415b-b6b0-adc3eef2b480 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1321 microversion: 2.1 time: 0.091405 Jul 14 12:23:09.330871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 345/681] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:09 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1321 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:09.518322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-fccec382-b470-496b-8c53-b833e99ef1c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:09.521105 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-fccec382-b470-496b-8c53-b833e99ef1c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:09.533661 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fccec382-b470-496b-8c53-b833e99ef1c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:09.534422 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fccec382-b470-496b-8c53-b833e99ef1c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:09.535837 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fccec382-b470-496b-8c53-b833e99ef1c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:09.536883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fccec382-b470-496b-8c53-b833e99ef1c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:09.580633 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-50b93798-c923-4811-bbf7-31adf0a71850 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:09.581582 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-50b93798-c923-4811-bbf7-31adf0a71850 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:09.588886 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-50b93798-c923-4811-bbf7-31adf0a71850 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:09.589664 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-50b93798-c923-4811-bbf7-31adf0a71850 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:09.590886 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-50b93798-c923-4811-bbf7-31adf0a71850 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:09.591568 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-50b93798-c923-4811-bbf7-31adf0a71850 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:09.696110 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-fccec382-b470-496b-8c53-b833e99ef1c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:09.704763 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-fccec382-b470-496b-8c53-b833e99ef1c3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.190773 Jul 14 12:23:09.705569 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 337/682] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:09 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:09.713892 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c4f62d39-cce6-43ec-a84f-685c89872a86 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:09.714603 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c4f62d39-cce6-43ec-a84f-685c89872a86 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:09.721310 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c4f62d39-cce6-43ec-a84f-685c89872a86 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:09.722092 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c4f62d39-cce6-43ec-a84f-685c89872a86 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:09.723168 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c4f62d39-cce6-43ec-a84f-685c89872a86 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:09.723854 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c4f62d39-cce6-43ec-a84f-685c89872a86 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:09.775525 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-50b93798-c923-4811-bbf7-31adf0a71850 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:09.784340 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-50b93798-c923-4811-bbf7-31adf0a71850 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1319 microversion: 2.1 time: 0.207672 Jul 14 12:23:09.795308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 346/683] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:09 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:09.884168 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c4f62d39-cce6-43ec-a84f-685c89872a86 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:09.892298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c4f62d39-cce6-43ec-a84f-685c89872a86 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1758 microversion: 2.1 time: 0.182387 Jul 14 12:23:09.892874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 338/684] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:09 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1758 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:10.346185 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:10.347856 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:10.354754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:10.355448 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:10.356220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:10.356656 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:10.390790 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:10.391578 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:10.392099 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lazy-loading 'fault' on Instance uuid d2634876-d37b-4436-9c61-23c72f9be7f0 {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:23:10.434651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:10.442128 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-00089e7d-a6a6-4b60-ae8d-15828535398a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 200 len: 1326 microversion: 2.1 time: 0.100310 Jul 14 12:23:10.442982 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 347/685] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:10 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:10.725385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-071b512c-3772-415f-9576-74fbe1f5ad5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:10.725989 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-071b512c-3772-415f-9576-74fbe1f5ad5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:10.733469 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-071b512c-3772-415f-9576-74fbe1f5ad5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:10.735867 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-071b512c-3772-415f-9576-74fbe1f5ad5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:10.735867 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-071b512c-3772-415f-9576-74fbe1f5ad5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:10.735867 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-071b512c-3772-415f-9576-74fbe1f5ad5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:10.803684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0463720a-f4a1-47a5-a717-e61728e3230a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:10.804473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0463720a-f4a1-47a5-a717-e61728e3230a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:10.811254 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0463720a-f4a1-47a5-a717-e61728e3230a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:10.811950 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0463720a-f4a1-47a5-a717-e61728e3230a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:10.812840 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0463720a-f4a1-47a5-a717-e61728e3230a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:10.813274 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0463720a-f4a1-47a5-a717-e61728e3230a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:10.896034 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-071b512c-3772-415f-9576-74fbe1f5ad5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:10.904996 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-071b512c-3772-415f-9576-74fbe1f5ad5a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.184011 Jul 14 12:23:10.905669 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 339/686] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:10 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:10.950955 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0463720a-f4a1-47a5-a717-e61728e3230a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:10.959692 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0463720a-f4a1-47a5-a717-e61728e3230a tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1507 microversion: 2.1 time: 0.160721 Jul 14 12:23:10.960453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 348/687] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:10 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:10.977314 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-89bef91d-f174-4df5-8280-5f49e87539e1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "744182f6-371d-45ba-b411-182c707f7e25", "device": "/dev/sdb"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:10.978497 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-89bef91d-f174-4df5-8280-5f49e87539e1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:10.984878 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-89bef91d-f174-4df5-8280-5f49e87539e1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:10.985454 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-89bef91d-f174-4df5-8280-5f49e87539e1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:10.986299 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-89bef91d-f174-4df5-8280-5f49e87539e1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:10.986834 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-89bef91d-f174-4df5-8280-5f49e87539e1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:11.459224 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-188d377d-ab1d-453c-8a61-524fb5dc6f8f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:11.459898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-188d377d-ab1d-453c-8a61-524fb5dc6f8f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:11.466302 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-188d377d-ab1d-453c-8a61-524fb5dc6f8f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:11.466792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-188d377d-ab1d-453c-8a61-524fb5dc6f8f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:11.467562 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-188d377d-ab1d-453c-8a61-524fb5dc6f8f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:11.468004 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-188d377d-ab1d-453c-8a61-524fb5dc6f8f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:11.482187 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-188d377d-ab1d-453c-8a61-524fb5dc6f8f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] HTTP exception thrown: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-188d377d-ab1d-453c-8a61-524fb5dc6f8f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Request method failure captured: Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 HTTP/1.1 Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AmNs7D8VSwR_-yNd_GBcPDVcneSBSiG5-fSaXfVjjGNbhDdXqCe9-lbEMbFx3XhSNwHomxn3h-GB9dMb5fL7AKbYScFosTfsgsRxy3XD3PrGLkUfp6vpotyjkVj97YJeH9I5KYc4y4EYjqAK_WFStx4CtAyI5GIg6erxhUcBVLiweM Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:23:11.489819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33b09a1d039248aa95a089c8d8d99c68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: d6da4b0616034aa1bb22c44a8f5ef280 Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:23:11.491364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'd2634876-d37b-4436-9c61-23c72f9be7f0'} Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:23:11.492263 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:23:11.493754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:23:11.495049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-188d377d-ab1d-453c-8a61-524fb5dc6f8f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Returning 404 to user: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:23:11.495049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-188d377d-ab1d-453c-8a61-524fb5dc6f8f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 404 len: 111 microversion: 2.1 time: 0.029963 Jul 14 12:23:11.495049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 349/688] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:11 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 12:23:11.495049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a4c9cc79-8d57-4eb3-a4ef-ba29fede9b43 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '.version_select at 0x7f0e26443c10>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:11.596789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a4c9cc79-8d57-4eb3-a4ef-ba29fede9b43 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-252502396" status: 202 len: 0 microversion: 2.1 time: 0.105722 Jul 14 12:23:11.597369 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 350/689] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jul 14 12:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-252502396 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:23:11.923240 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4c36893b-1f81-40b7-a994-303f3814d0a4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:11.923921 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4c36893b-1f81-40b7-a994-303f3814d0a4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:11.934441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4c36893b-1f81-40b7-a994-303f3814d0a4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:11.934441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4c36893b-1f81-40b7-a994-303f3814d0a4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:11.934441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4c36893b-1f81-40b7-a994-303f3814d0a4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:11.934441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4c36893b-1f81-40b7-a994-303f3814d0a4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:11.967568 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-89bef91d-f174-4df5-8280-5f49e87539e1 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "POST /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.994917 Jul 14 12:23:11.968852 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 340/690] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:23:10 2022] POST /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6/os-volume_attachments => generated 194 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:12.069743 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4c36893b-1f81-40b7-a994-303f3814d0a4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:12.077798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4c36893b-1f81-40b7-a994-303f3814d0a4 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.158849 Jul 14 12:23:12.078446 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 351/691] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:11 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:12.389262 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-655756f4-36d4-438d-8070-881f45e4a317 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'create', calling method: .version_select at 0x7f0e264dc790>, body: {"keypair": {"name": "tempest-keypair-1758254479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNB9yvcX9QXasAljHS/xtTq83+1xrhvXzL4EVxMx0ac5WAD4RYrfFAdCCxbqJ+ALX+l9JlLHk5CKNWollP/gog2pEKF0dN0/FSOUoQ2i0clTPod0Sm0SsZJu5xhl1ImMRw=="}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:12.403016 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-655756f4-36d4-438d-8070-881f45e4a317 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Getting quotas for project 33b09a1d039248aa95a089c8d8d99c68. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:23:12.406689 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-655756f4-36d4-438d-8070-881f45e4a317 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Getting quotas for user d6da4b0616034aa1bb22c44a8f5ef280 and project 33b09a1d039248aa95a089c8d8d99c68. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:23:12.505708 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-655756f4-36d4-438d-8070-881f45e4a317 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.120029 Jul 14 12:23:12.506216 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 341/692] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 12:23:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:13.103466 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4e83dac0-404f-4ce7-916d-a0f73dc1cc0a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:13.104105 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4e83dac0-404f-4ce7-916d-a0f73dc1cc0a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:13.111064 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4e83dac0-404f-4ce7-916d-a0f73dc1cc0a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:13.111510 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4e83dac0-404f-4ce7-916d-a0f73dc1cc0a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:13.112285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4e83dac0-404f-4ce7-916d-a0f73dc1cc0a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:13.112719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4e83dac0-404f-4ce7-916d-a0f73dc1cc0a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:13.243088 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4e83dac0-404f-4ce7-916d-a0f73dc1cc0a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:13.251107 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4e83dac0-404f-4ce7-916d-a0f73dc1cc0a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.151792 Jul 14 12:23:13.251960 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 352/693] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:13 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:14.269694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-68bf30bc-aab1-49af-b242-33755d0c56ed tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:14.271113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-68bf30bc-aab1-49af-b242-33755d0c56ed tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:14.273039 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:14.278594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-68bf30bc-aab1-49af-b242-33755d0c56ed tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:14.279092 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-68bf30bc-aab1-49af-b242-33755d0c56ed tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:14.279948 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-68bf30bc-aab1-49af-b242-33755d0c56ed tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:14.280260 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-68bf30bc-aab1-49af-b242-33755d0c56ed tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:14.722863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-68bf30bc-aab1-49af-b242-33755d0c56ed tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:14.731076 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-68bf30bc-aab1-49af-b242-33755d0c56ed tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.465667 Jul 14 12:23:14.736067 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 342/694] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:14 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:14.883830 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-356823521", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7a5d35d-c460-4290-bd4b-813214351817"}], "security_groups": [{"name": "tempest-securitygroup--1826746733"}], "key_name": "tempest-keypair-1758254479", "user_data": "}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:14.985171 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.network.neutron [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] validate_networks() for [('d7a5d35d-c460-4290-bd4b-813214351817', None, None, None, None, None)] {{(pid=118262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:23:15.355921 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Flavor limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:23:15.356367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Image limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:23:15.356838 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Flavor pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:23:15.357246 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Image pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:23:15.357775 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:23:15.366691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:15.367176 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:15.367966 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:15.368397 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:15.384730 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Getting quotas for project 33b09a1d039248aa95a089c8d8d99c68. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:23:15.388673 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Getting quotas for user d6da4b0616034aa1bb22c44a8f5ef280 and project 33b09a1d039248aa95a089c8d8d99c68. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:23:15.399788 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Going to run 1 instances... {{(pid=118262) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:23:15.401999 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:23:15.562902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fc9c5bb3-ac98-4fdd-95c7-8a126188dd71 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.684065 Jul 14 12:23:15.563808 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 353/695] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:23:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:23:15.573706 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d6691cb7-9f74-4e7c-a439-e2e18f25e597 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:15.574460 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d6691cb7-9f74-4e7c-a439-e2e18f25e597 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:15.628056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d6691cb7-9f74-4e7c-a439-e2e18f25e597 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:15.635082 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d6691cb7-9f74-4e7c-a439-e2e18f25e597 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1237 microversion: 2.1 time: 0.065234 Jul 14 12:23:15.635821 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 343/696] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:15 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:15.749121 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e3956b27-e5bb-4b91-8c79-e4b21a8db9e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:15.749734 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e3956b27-e5bb-4b91-8c79-e4b21a8db9e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:15.756485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e3956b27-e5bb-4b91-8c79-e4b21a8db9e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:15.756963 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e3956b27-e5bb-4b91-8c79-e4b21a8db9e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:15.757722 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e3956b27-e5bb-4b91-8c79-e4b21a8db9e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:15.758159 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e3956b27-e5bb-4b91-8c79-e4b21a8db9e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:15.890978 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e3956b27-e5bb-4b91-8c79-e4b21a8db9e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:15.900315 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e3956b27-e5bb-4b91-8c79-e4b21a8db9e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.155214 Jul 14 12:23:15.900879 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 354/697] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:15 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:16.651539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c6285c15-bede-40df-bbdf-91e1e2be58d0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:16.652091 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c6285c15-bede-40df-bbdf-91e1e2be58d0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:16.659439 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c6285c15-bede-40df-bbdf-91e1e2be58d0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:16.659891 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c6285c15-bede-40df-bbdf-91e1e2be58d0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:16.661230 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c6285c15-bede-40df-bbdf-91e1e2be58d0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:16.661665 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c6285c15-bede-40df-bbdf-91e1e2be58d0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:16.728285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c6285c15-bede-40df-bbdf-91e1e2be58d0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:16.735738 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c6285c15-bede-40df-bbdf-91e1e2be58d0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1241 microversion: 2.1 time: 0.088223 Jul 14 12:23:16.736311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 344/698] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:16 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:16.918288 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-38c0f288-d55c-4b27-93c9-6b02e95f84d3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:16.919066 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-38c0f288-d55c-4b27-93c9-6b02e95f84d3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:16.925863 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-38c0f288-d55c-4b27-93c9-6b02e95f84d3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:16.926318 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-38c0f288-d55c-4b27-93c9-6b02e95f84d3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:16.927132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-38c0f288-d55c-4b27-93c9-6b02e95f84d3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:16.927592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-38c0f288-d55c-4b27-93c9-6b02e95f84d3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:17.057000 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-38c0f288-d55c-4b27-93c9-6b02e95f84d3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:17.064968 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-38c0f288-d55c-4b27-93c9-6b02e95f84d3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.150652 Jul 14 12:23:17.065541 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 355/699] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:16 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:17.752892 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c25bea90-add2-4960-a466-7fb53ff6c895 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:17.753497 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c25bea90-add2-4960-a466-7fb53ff6c895 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:17.761747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c25bea90-add2-4960-a466-7fb53ff6c895 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:17.762195 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c25bea90-add2-4960-a466-7fb53ff6c895 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:17.762995 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c25bea90-add2-4960-a466-7fb53ff6c895 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:17.763431 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c25bea90-add2-4960-a466-7fb53ff6c895 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:17.894133 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c25bea90-add2-4960-a466-7fb53ff6c895 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:17.901805 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c25bea90-add2-4960-a466-7fb53ff6c895 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1297 microversion: 2.1 time: 0.152981 Jul 14 12:23:17.902438 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 345/700] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:17 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1297 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:18.082387 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a260dcf6-b10e-41d4-8819-423fffd3b26a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:18.083189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a260dcf6-b10e-41d4-8819-423fffd3b26a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:18.085526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:18.090415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a260dcf6-b10e-41d4-8819-423fffd3b26a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:18.090899 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a260dcf6-b10e-41d4-8819-423fffd3b26a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:18.091679 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a260dcf6-b10e-41d4-8819-423fffd3b26a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:18.092123 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a260dcf6-b10e-41d4-8819-423fffd3b26a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:18.279998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a260dcf6-b10e-41d4-8819-423fffd3b26a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:18.289055 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a260dcf6-b10e-41d4-8819-423fffd3b26a tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.210546 Jul 14 12:23:18.289898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 356/701] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:18 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:18.919496 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-86089165-5f46-4397-aff3-40ffb15d7182 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:18.920358 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-86089165-5f46-4397-aff3-40ffb15d7182 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:18.927014 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-86089165-5f46-4397-aff3-40ffb15d7182 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:18.927458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-86089165-5f46-4397-aff3-40ffb15d7182 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:18.928219 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-86089165-5f46-4397-aff3-40ffb15d7182 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:18.928652 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-86089165-5f46-4397-aff3-40ffb15d7182 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:19.131712 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-86089165-5f46-4397-aff3-40ffb15d7182 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:19.139245 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-86089165-5f46-4397-aff3-40ffb15d7182 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.223578 Jul 14 12:23:19.139812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 346/702] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:18 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:19.307237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-20c6615d-4e30-4b8e-9f1b-b6155fc39397 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:19.307843 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-20c6615d-4e30-4b8e-9f1b-b6155fc39397 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:19.314346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-20c6615d-4e30-4b8e-9f1b-b6155fc39397 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:19.314812 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-20c6615d-4e30-4b8e-9f1b-b6155fc39397 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:19.315574 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-20c6615d-4e30-4b8e-9f1b-b6155fc39397 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:19.316005 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-20c6615d-4e30-4b8e-9f1b-b6155fc39397 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:19.471498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-20c6615d-4e30-4b8e-9f1b-b6155fc39397 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:19.480760 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-20c6615d-4e30-4b8e-9f1b-b6155fc39397 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.177497 Jul 14 12:23:19.481342 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 357/703] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:19 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:19.675042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-22ee2c8a-e211-46bf-896d-f153a4939882 req-2498125e-87c6-40c9-918e-dc8f9c22ca69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439", "tag": "ee3d4bc1-a084-42b2-91b9-f0df7fc2510b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:19.687031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-22ee2c8a-e211-46bf-896d-f153a4939882 req-2498125e-87c6-40c9-918e-dc8f9c22ca69 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:19.687726 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-22ee2c8a-e211-46bf-896d-f153a4939882 req-2498125e-87c6-40c9-918e-dc8f9c22ca69 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:19.702187 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-22ee2c8a-e211-46bf-896d-f153a4939882 req-2498125e-87c6-40c9-918e-dc8f9c22ca69 service nova] Creating event network-changed:ee3d4bc1-a084-42b2-91b9-f0df7fc2510b for instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 on hv-cinder-84890 Jul 14 12:23:19.707849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-22ee2c8a-e211-46bf-896d-f153a4939882 req-2498125e-87c6-40c9-918e-dc8f9c22ca69 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036491 Jul 14 12:23:19.712042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 347/704] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:20.157952 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-520c50db-8197-477a-abc0-8a691573af98 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:20.158573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-520c50db-8197-477a-abc0-8a691573af98 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:20.165179 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-520c50db-8197-477a-abc0-8a691573af98 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:20.165850 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-520c50db-8197-477a-abc0-8a691573af98 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:20.166631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-520c50db-8197-477a-abc0-8a691573af98 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:20.167123 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-520c50db-8197-477a-abc0-8a691573af98 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:20.298183 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-520c50db-8197-477a-abc0-8a691573af98 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:20.306251 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-520c50db-8197-477a-abc0-8a691573af98 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.153150 Jul 14 12:23:20.306842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 358/705] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:20 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:20.499934 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-03cbad0a-d739-4456-a818-b4ff78435b5d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:20.500763 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-03cbad0a-d739-4456-a818-b4ff78435b5d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:20.507591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03cbad0a-d739-4456-a818-b4ff78435b5d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:20.508069 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03cbad0a-d739-4456-a818-b4ff78435b5d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:20.512471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03cbad0a-d739-4456-a818-b4ff78435b5d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:20.512471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03cbad0a-d739-4456-a818-b4ff78435b5d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:20.650599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-03cbad0a-d739-4456-a818-b4ff78435b5d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:20.658601 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-03cbad0a-d739-4456-a818-b4ff78435b5d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.163660 Jul 14 12:23:20.659201 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 348/706] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:20 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:21.375445 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1cf69e83-9487-46c5-b7a3-45d015f57abf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:21.376237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1cf69e83-9487-46c5-b7a3-45d015f57abf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:21.383118 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1cf69e83-9487-46c5-b7a3-45d015f57abf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:21.383596 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1cf69e83-9487-46c5-b7a3-45d015f57abf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:21.384411 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1cf69e83-9487-46c5-b7a3-45d015f57abf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:21.384895 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1cf69e83-9487-46c5-b7a3-45d015f57abf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:21.516757 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1cf69e83-9487-46c5-b7a3-45d015f57abf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:21.524158 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1cf69e83-9487-46c5-b7a3-45d015f57abf tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.204311 Jul 14 12:23:21.524730 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 359/707] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:21 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:21.677354 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9df01ef7-a249-4522-8b5c-886373c34d34 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:21.677901 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9df01ef7-a249-4522-8b5c-886373c34d34 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:21.684388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9df01ef7-a249-4522-8b5c-886373c34d34 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:21.684832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9df01ef7-a249-4522-8b5c-886373c34d34 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:21.685651 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9df01ef7-a249-4522-8b5c-886373c34d34 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:21.686086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9df01ef7-a249-4522-8b5c-886373c34d34 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:21.814232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9df01ef7-a249-4522-8b5c-886373c34d34 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:21.822569 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9df01ef7-a249-4522-8b5c-886373c34d34 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.149728 Jul 14 12:23:21.823184 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 349/708] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:21 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:22.540464 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0885c4fc-9abc-4f9e-bd21-6f324d4ace64 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:22.541046 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0885c4fc-9abc-4f9e-bd21-6f324d4ace64 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:22.547729 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0885c4fc-9abc-4f9e-bd21-6f324d4ace64 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:22.548173 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0885c4fc-9abc-4f9e-bd21-6f324d4ace64 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:22.548924 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0885c4fc-9abc-4f9e-bd21-6f324d4ace64 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:22.549353 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0885c4fc-9abc-4f9e-bd21-6f324d4ace64 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:22.553279 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=100 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:22.677632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0885c4fc-9abc-4f9e-bd21-6f324d4ace64 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:22.684971 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0885c4fc-9abc-4f9e-bd21-6f324d4ace64 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.148314 Jul 14 12:23:22.685529 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 360/709] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:22 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:22.839494 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d04867ee-eac8-4324-a689-031992f28a25 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:22.841239 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d04867ee-eac8-4324-a689-031992f28a25 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:22.848708 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d04867ee-eac8-4324-a689-031992f28a25 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:22.849188 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d04867ee-eac8-4324-a689-031992f28a25 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:22.849981 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d04867ee-eac8-4324-a689-031992f28a25 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:22.850420 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d04867ee-eac8-4324-a689-031992f28a25 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:22.979422 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d04867ee-eac8-4324-a689-031992f28a25 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:22.987309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d04867ee-eac8-4324-a689-031992f28a25 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.151989 Jul 14 12:23:22.987870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 350/710] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:22 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:23.702230 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ca7ed58e-9339-446f-b105-42654cf74f70 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:23.703036 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ca7ed58e-9339-446f-b105-42654cf74f70 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:23.710065 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca7ed58e-9339-446f-b105-42654cf74f70 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:23.710514 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca7ed58e-9339-446f-b105-42654cf74f70 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:23.711313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca7ed58e-9339-446f-b105-42654cf74f70 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:23.711753 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ca7ed58e-9339-446f-b105-42654cf74f70 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:23.843895 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ca7ed58e-9339-446f-b105-42654cf74f70 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:23.851173 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ca7ed58e-9339-446f-b105-42654cf74f70 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.152800 Jul 14 12:23:23.851736 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 361/711] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:23 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:24.004530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d406790e-3c97-4a46-97c8-3a77a211c1ef tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:24.005281 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d406790e-3c97-4a46-97c8-3a77a211c1ef tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:24.011839 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d406790e-3c97-4a46-97c8-3a77a211c1ef tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:24.015425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d406790e-3c97-4a46-97c8-3a77a211c1ef tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:24.015425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d406790e-3c97-4a46-97c8-3a77a211c1ef tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:24.015425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d406790e-3c97-4a46-97c8-3a77a211c1ef tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:24.142122 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d406790e-3c97-4a46-97c8-3a77a211c1ef tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:24.151611 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d406790e-3c97-4a46-97c8-3a77a211c1ef tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.151107 Jul 14 12:23:24.152192 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 351/712] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:23 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:24.868436 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4e674a3f-c027-4f1b-b4b1-0b48fb5a7cda tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:24.869077 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4e674a3f-c027-4f1b-b4b1-0b48fb5a7cda tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:24.875633 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4e674a3f-c027-4f1b-b4b1-0b48fb5a7cda tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:24.876083 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4e674a3f-c027-4f1b-b4b1-0b48fb5a7cda tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:24.876880 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4e674a3f-c027-4f1b-b4b1-0b48fb5a7cda tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:24.877316 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4e674a3f-c027-4f1b-b4b1-0b48fb5a7cda tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:25.009405 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4e674a3f-c027-4f1b-b4b1-0b48fb5a7cda tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:25.017009 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4e674a3f-c027-4f1b-b4b1-0b48fb5a7cda tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.152495 Jul 14 12:23:25.020542 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 362/713] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:24 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:25.180049 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c0d0b165-a76c-45c6-a1d6-3cd6ca7f7796 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:25.180660 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c0d0b165-a76c-45c6-a1d6-3cd6ca7f7796 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:25.187120 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0d0b165-a76c-45c6-a1d6-3cd6ca7f7796 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:25.187578 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0d0b165-a76c-45c6-a1d6-3cd6ca7f7796 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:25.188343 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0d0b165-a76c-45c6-a1d6-3cd6ca7f7796 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:25.188783 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0d0b165-a76c-45c6-a1d6-3cd6ca7f7796 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:25.321892 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c0d0b165-a76c-45c6-a1d6-3cd6ca7f7796 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:25.330068 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c0d0b165-a76c-45c6-a1d6-3cd6ca7f7796 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.154014 Jul 14 12:23:25.330641 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 352/714] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:25 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:26.033676 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b777a3fb-302f-4ed4-864a-dd254d1786b7 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:26.034278 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b777a3fb-302f-4ed4-864a-dd254d1786b7 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:26.036782 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:26.037421 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=6 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:26.042713 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b777a3fb-302f-4ed4-864a-dd254d1786b7 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:26.043186 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b777a3fb-302f-4ed4-864a-dd254d1786b7 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:26.047112 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b777a3fb-302f-4ed4-864a-dd254d1786b7 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:26.047112 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b777a3fb-302f-4ed4-864a-dd254d1786b7 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:26.174379 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b777a3fb-302f-4ed4-864a-dd254d1786b7 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:26.182745 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b777a3fb-302f-4ed4-864a-dd254d1786b7 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.152836 Jul 14 12:23:26.183340 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 363/715] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:26 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:26.347253 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f662ccba-48a7-4876-a65d-fd035adb971f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:26.347871 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f662ccba-48a7-4876-a65d-fd035adb971f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:26.349773 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=6 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:26.355041 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f662ccba-48a7-4876-a65d-fd035adb971f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:26.355491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f662ccba-48a7-4876-a65d-fd035adb971f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:26.362695 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f662ccba-48a7-4876-a65d-fd035adb971f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:26.362695 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f662ccba-48a7-4876-a65d-fd035adb971f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:26.362695 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:26.485608 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f662ccba-48a7-4876-a65d-fd035adb971f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:26.493505 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f662ccba-48a7-4876-a65d-fd035adb971f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.150194 Jul 14 12:23:26.500469 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 353/716] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:26 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:27.199570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-270c1f99-8515-4ea8-8f80-d65ed0bdb5fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:27.200176 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-270c1f99-8515-4ea8-8f80-d65ed0bdb5fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:27.206557 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-270c1f99-8515-4ea8-8f80-d65ed0bdb5fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:27.207216 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-270c1f99-8515-4ea8-8f80-d65ed0bdb5fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:27.207977 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-270c1f99-8515-4ea8-8f80-d65ed0bdb5fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:27.208403 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-270c1f99-8515-4ea8-8f80-d65ed0bdb5fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:27.333507 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-270c1f99-8515-4ea8-8f80-d65ed0bdb5fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:27.340850 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-270c1f99-8515-4ea8-8f80-d65ed0bdb5fc tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.145057 Jul 14 12:23:27.341425 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 364/717] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:27 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:27.510791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2e0e17d3-ba8e-4d99-8b35-0a3fffbd32e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:27.511405 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2e0e17d3-ba8e-4d99-8b35-0a3fffbd32e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:27.518156 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e0e17d3-ba8e-4d99-8b35-0a3fffbd32e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:27.518602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e0e17d3-ba8e-4d99-8b35-0a3fffbd32e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:27.519924 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e0e17d3-ba8e-4d99-8b35-0a3fffbd32e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:27.520441 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e0e17d3-ba8e-4d99-8b35-0a3fffbd32e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:27.645491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2e0e17d3-ba8e-4d99-8b35-0a3fffbd32e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:27.653414 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2e0e17d3-ba8e-4d99-8b35-0a3fffbd32e8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.146738 Jul 14 12:23:27.653988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 354/718] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:27 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:28.357780 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-64faa6a0-75fe-4c1a-b3ab-15011d52b55f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:28.358441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-64faa6a0-75fe-4c1a-b3ab-15011d52b55f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:28.365470 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-64faa6a0-75fe-4c1a-b3ab-15011d52b55f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:28.365916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-64faa6a0-75fe-4c1a-b3ab-15011d52b55f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:28.366676 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-64faa6a0-75fe-4c1a-b3ab-15011d52b55f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:28.367441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-64faa6a0-75fe-4c1a-b3ab-15011d52b55f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:28.498302 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-64faa6a0-75fe-4c1a-b3ab-15011d52b55f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:28.505993 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-64faa6a0-75fe-4c1a-b3ab-15011d52b55f tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.152192 Jul 14 12:23:28.506556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 365/719] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:28 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:28.671473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0169b991-c329-4af0-99ae-6a75d5000b4b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:28.671997 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0169b991-c329-4af0-99ae-6a75d5000b4b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:28.679039 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0169b991-c329-4af0-99ae-6a75d5000b4b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:28.679479 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0169b991-c329-4af0-99ae-6a75d5000b4b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:28.680236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0169b991-c329-4af0-99ae-6a75d5000b4b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:28.680674 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0169b991-c329-4af0-99ae-6a75d5000b4b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:28.817304 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0169b991-c329-4af0-99ae-6a75d5000b4b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:28.825348 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0169b991-c329-4af0-99ae-6a75d5000b4b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.158004 Jul 14 12:23:28.825920 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 355/720] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:28 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:29.522995 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1c02f68d-d1d6-49b2-b8a3-4852f96c6c54 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:29.523609 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1c02f68d-d1d6-49b2-b8a3-4852f96c6c54 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:29.530177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1c02f68d-d1d6-49b2-b8a3-4852f96c6c54 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:29.530802 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1c02f68d-d1d6-49b2-b8a3-4852f96c6c54 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:29.531438 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1c02f68d-d1d6-49b2-b8a3-4852f96c6c54 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:29.531856 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1c02f68d-d1d6-49b2-b8a3-4852f96c6c54 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:29.673562 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1c02f68d-d1d6-49b2-b8a3-4852f96c6c54 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:29.681561 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1c02f68d-d1d6-49b2-b8a3-4852f96c6c54 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.162989 Jul 14 12:23:29.682125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 366/721] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:29 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:29.843933 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b4310149-7b42-4ded-b7e4-36d631040b70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:29.844534 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b4310149-7b42-4ded-b7e4-36d631040b70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:29.851150 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b4310149-7b42-4ded-b7e4-36d631040b70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:29.851595 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b4310149-7b42-4ded-b7e4-36d631040b70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:29.852343 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b4310149-7b42-4ded-b7e4-36d631040b70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:29.852798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b4310149-7b42-4ded-b7e4-36d631040b70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:30.056079 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b4310149-7b42-4ded-b7e4-36d631040b70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:30.064149 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b4310149-7b42-4ded-b7e4-36d631040b70 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1735 microversion: 2.1 time: 0.224072 Jul 14 12:23:30.065807 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 356/722] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:29 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:30.698199 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-da9bd5e4-522e-41e1-a02a-85dfdeaa91ed tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:30.698834 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-da9bd5e4-522e-41e1-a02a-85dfdeaa91ed tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:30.706249 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da9bd5e4-522e-41e1-a02a-85dfdeaa91ed tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:30.707301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da9bd5e4-522e-41e1-a02a-85dfdeaa91ed tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:30.708264 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da9bd5e4-522e-41e1-a02a-85dfdeaa91ed tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:30.708706 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da9bd5e4-522e-41e1-a02a-85dfdeaa91ed tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:30.842300 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-da9bd5e4-522e-41e1-a02a-85dfdeaa91ed tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:30.850452 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-da9bd5e4-522e-41e1-a02a-85dfdeaa91ed tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.156164 Jul 14 12:23:30.851041 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 367/723] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:30 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:31.081412 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5cbe0a5e-bb7d-4397-8770-2eebd5910604 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:31.082522 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5cbe0a5e-bb7d-4397-8770-2eebd5910604 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:31.089221 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5cbe0a5e-bb7d-4397-8770-2eebd5910604 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:31.089674 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5cbe0a5e-bb7d-4397-8770-2eebd5910604 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:31.090446 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5cbe0a5e-bb7d-4397-8770-2eebd5910604 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:31.090916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5cbe0a5e-bb7d-4397-8770-2eebd5910604 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:31.326082 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5cbe0a5e-bb7d-4397-8770-2eebd5910604 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:31.334685 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5cbe0a5e-bb7d-4397-8770-2eebd5910604 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1715 microversion: 2.1 time: 0.257185 Jul 14 12:23:31.335221 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 357/724] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:31 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1715 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:31.387101 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a55640c6-9b8c-45f5-be8a-d1c1d7db751e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:31.387595 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a55640c6-9b8c-45f5-be8a-d1c1d7db751e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:31.393534 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a55640c6-9b8c-45f5-be8a-d1c1d7db751e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:31.393977 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a55640c6-9b8c-45f5-be8a-d1c1d7db751e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:31.394733 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a55640c6-9b8c-45f5-be8a-d1c1d7db751e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:31.395820 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a55640c6-9b8c-45f5-be8a-d1c1d7db751e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:31.476172 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-a55640c6-9b8c-45f5-be8a-d1c1d7db751e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] HTTP exception thrown: Cannot 'detach_volume' instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e while it is in vm_state rescued Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a55640c6-9b8c-45f5-be8a-d1c1d7db751e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Request method failure captured: Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: DELETE /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments/7d220846-5fa5-4e50-a7be-6501e3f67291 HTTP/1.1 Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AmW5SsGlFhf_TzJg-Og2kuIVv8Fr87QiUijllnSUBvnbHpUzpWuE-rphTVE092MKeLDRhLcGVdyeyzuLP58QmtlbDaIh0UNR1NEJmPgt08fjsBh5C6AY25wIZL2k57HAqwpUFzHaNbhMhB6AWiQ5Zhrh_g09fa_3mXp-B0btNHrPWQ Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: bb62d84584b3426687390833270648d6 Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:23:31.477694 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb62d84584b3426687390833270648d6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb62d84584b3426687390833270648d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb62d84584b3426687390833270648d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb62d84584b3426687390833270648d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: bb62d84584b3426687390833270648d6 Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-ServerRescueNegativeTestJSON-1890584384-project Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 0d302e57946c42d799e9bf120873eba6 Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1890584384-project Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:23:31.479299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Cannot 'detach_volume' instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e while it is in vm_state rescued Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'server_id': '158005c6-a074-4abf-a8b8-7c1ee3250b2e', 'id': '7d220846-5fa5-4e50-a7be-6501e3f67291'} Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:23:31.480190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e while it is in vm_state rescued Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e while it is in vm_state rescued Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:23:31.481764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a55640c6-9b8c-45f5-be8a-d1c1d7db751e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Returning 409 to user: Cannot 'detach_volume' instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e while it is in vm_state rescued {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:23:31.483115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a55640c6-9b8c-45f5-be8a-d1c1d7db751e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments/7d220846-5fa5-4e50-a7be-6501e3f67291" status: 409 len: 152 microversion: 2.1 time: 0.095963 Jul 14 12:23:31.483115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 368/725] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:23:31 2022] DELETE /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments/7d220846-5fa5-4e50-a7be-6501e3f67291 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 12:23:31.487899 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-25d958d3-9f88-4084-9947-f537633beec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:31.488431 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-25d958d3-9f88-4084-9947-f537633beec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:31.494333 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25d958d3-9f88-4084-9947-f537633beec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:31.494791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25d958d3-9f88-4084-9947-f537633beec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:31.495552 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25d958d3-9f88-4084-9947-f537633beec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:31.495983 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-25d958d3-9f88-4084-9947-f537633beec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:31.711929 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-25d958d3-9f88-4084-9947-f537633beec8 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "POST /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/action" status: 202 len: 0 microversion: 2.1 time: 0.227634 Jul 14 12:23:31.712768 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 358/726] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:23:31 2022] POST /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:23:31.720896 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8152e24b-d246-4495-a0a9-c076a5130915 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:31.721516 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8152e24b-d246-4495-a0a9-c076a5130915 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:31.729994 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8152e24b-d246-4495-a0a9-c076a5130915 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:31.730221 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8152e24b-d246-4495-a0a9-c076a5130915 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:31.731027 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8152e24b-d246-4495-a0a9-c076a5130915 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:31.731456 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8152e24b-d246-4495-a0a9-c076a5130915 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:31.868204 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5be47771-ecdd-4b3c-a726-8878c4819c09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:31.868487 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8152e24b-d246-4495-a0a9-c076a5130915 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:31.868981 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5be47771-ecdd-4b3c-a726-8878c4819c09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:31.877056 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8152e24b-d246-4495-a0a9-c076a5130915 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1723 microversion: 2.1 time: 0.159997 Jul 14 12:23:31.877635 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 369/727] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:31 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:31.880373 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5be47771-ecdd-4b3c-a726-8878c4819c09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:31.883776 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5be47771-ecdd-4b3c-a726-8878c4819c09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:31.883776 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5be47771-ecdd-4b3c-a726-8878c4819c09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:31.883776 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5be47771-ecdd-4b3c-a726-8878c4819c09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:32.083460 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5be47771-ecdd-4b3c-a726-8878c4819c09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:32.091337 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5be47771-ecdd-4b3c-a726-8878c4819c09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.227814 Jul 14 12:23:32.091906 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 359/728] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:31 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:32.591701 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-7fdd7934-b68c-4c96-bf8b-e729b89f1c73 req-49f1258f-250a-4002-bf85-c54519931444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439", "name": "network-vif-plugged", "status": "completed", "tag": "ee3d4bc1-a084-42b2-91b9-f0df7fc2510b"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:32.600672 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-7fdd7934-b68c-4c96-bf8b-e729b89f1c73 req-49f1258f-250a-4002-bf85-c54519931444 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:32.601151 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-7fdd7934-b68c-4c96-bf8b-e729b89f1c73 req-49f1258f-250a-4002-bf85-c54519931444 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:32.613332 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-7fdd7934-b68c-4c96-bf8b-e729b89f1c73 req-49f1258f-250a-4002-bf85-c54519931444 service nova] Creating event network-vif-plugged:ee3d4bc1-a084-42b2-91b9-f0df7fc2510b for instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 on hv-cinder-84890 Jul 14 12:23:32.618622 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-7fdd7934-b68c-4c96-bf8b-e729b89f1c73 req-49f1258f-250a-4002-bf85-c54519931444 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031363 Jul 14 12:23:32.619523 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 370/729] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:32.800733 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5e7c13a6-55e5-480d-8404-750fbe4e15b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:32.801957 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5e7c13a6-55e5-480d-8404-750fbe4e15b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:32.808411 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5e7c13a6-55e5-480d-8404-750fbe4e15b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:32.808835 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5e7c13a6-55e5-480d-8404-750fbe4e15b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:32.809600 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5e7c13a6-55e5-480d-8404-750fbe4e15b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:32.810035 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5e7c13a6-55e5-480d-8404-750fbe4e15b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:32.833763 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-5e7c13a6-55e5-480d-8404-750fbe4e15b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lazy-loading 'flavor' on Instance uuid 905d8954-a633-4e05-a5eb-1bd833799fea {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:23:32.901350 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f607f3f8-3caf-495f-8271-9d0e6e0a5ca3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:32.902064 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f607f3f8-3caf-495f-8271-9d0e6e0a5ca3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:32.908783 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f607f3f8-3caf-495f-8271-9d0e6e0a5ca3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:32.909559 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f607f3f8-3caf-495f-8271-9d0e6e0a5ca3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:32.910032 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f607f3f8-3caf-495f-8271-9d0e6e0a5ca3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:32.910472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f607f3f8-3caf-495f-8271-9d0e6e0a5ca3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:33.046361 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f607f3f8-3caf-495f-8271-9d0e6e0a5ca3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:33.054503 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f607f3f8-3caf-495f-8271-9d0e6e0a5ca3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1723 microversion: 2.1 time: 0.157763 Jul 14 12:23:33.055102 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 371/730] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:32 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:33.063124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c979a5ec-b005-45d2-bebe-cb4010482d59 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:33.063124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c979a5ec-b005-45d2-bebe-cb4010482d59 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:33.065787 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c979a5ec-b005-45d2-bebe-cb4010482d59 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:33.066279 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c979a5ec-b005-45d2-bebe-cb4010482d59 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:33.067105 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c979a5ec-b005-45d2-bebe-cb4010482d59 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:33.067600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c979a5ec-b005-45d2-bebe-cb4010482d59 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:33.090070 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5e7c13a6-55e5-480d-8404-750fbe4e15b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "POST /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea/action" status: 202 len: 0 microversion: 2.1 time: 0.292979 Jul 14 12:23:33.094119 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 360/731] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:23:32 2022] POST /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:23:33.100345 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-fde751dc-525e-470d-8faf-b97ad9bc995b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:33.101053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-fde751dc-525e-470d-8faf-b97ad9bc995b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:33.107705 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fde751dc-525e-470d-8faf-b97ad9bc995b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:33.110527 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fde751dc-525e-470d-8faf-b97ad9bc995b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:33.110527 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fde751dc-525e-470d-8faf-b97ad9bc995b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:33.110527 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fde751dc-525e-470d-8faf-b97ad9bc995b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:33.149472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-c979a5ec-b005-45d2-bebe-cb4010482d59 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lazy-loading 'services' on Instance uuid a5c5780a-6bcf-4be9-8453-318344d781a6 {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:23:33.247463 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-fde751dc-525e-470d-8faf-b97ad9bc995b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:33.255685 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-fde751dc-525e-470d-8faf-b97ad9bc995b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.160250 Jul 14 12:23:33.256270 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 361/732] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:33 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:33.260795 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ea0c73a0-a565-470f-ab58-88154d5e8084 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:33.261396 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ea0c73a0-a565-470f-ab58-88154d5e8084 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:33.267169 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ea0c73a0-a565-470f-ab58-88154d5e8084 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:33.267620 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ea0c73a0-a565-470f-ab58-88154d5e8084 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:33.268382 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ea0c73a0-a565-470f-ab58-88154d5e8084 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:33.268821 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ea0c73a0-a565-470f-ab58-88154d5e8084 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:33.349009 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c979a5ec-b005-45d2-bebe-cb4010482d59 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6/os-volume_attachments/744182f6-371d-45ba-b411-182c707f7e25" status: 202 len: 0 microversion: 2.1 time: 0.292128 Jul 14 12:23:33.349802 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 372/733] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:23:33 2022] DELETE /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6/os-volume_attachments/744182f6-371d-45ba-b411-182c707f7e25 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:23:33.401277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ea0c73a0-a565-470f-ab58-88154d5e8084 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:33.408762 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ea0c73a0-a565-470f-ab58-88154d5e8084 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.151375 Jul 14 12:23:33.409307 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 362/734] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:33 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:34.072171 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d3de7a98-b1cb-4a04-8435-e7c0800933a5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:34.072875 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d3de7a98-b1cb-4a04-8435-e7c0800933a5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:34.079076 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d3de7a98-b1cb-4a04-8435-e7c0800933a5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:34.079527 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d3de7a98-b1cb-4a04-8435-e7c0800933a5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:34.080288 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d3de7a98-b1cb-4a04-8435-e7c0800933a5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:34.080716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d3de7a98-b1cb-4a04-8435-e7c0800933a5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:34.209738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d3de7a98-b1cb-4a04-8435-e7c0800933a5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:34.217587 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d3de7a98-b1cb-4a04-8435-e7c0800933a5 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1723 microversion: 2.1 time: 0.150410 Jul 14 12:23:34.218153 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 373/735] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:34 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:34.272917 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-48e9e295-1bd4-49d4-be8b-1df3ef77b36f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:34.273432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-48e9e295-1bd4-49d4-be8b-1df3ef77b36f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:34.279792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-48e9e295-1bd4-49d4-be8b-1df3ef77b36f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:34.280237 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-48e9e295-1bd4-49d4-be8b-1df3ef77b36f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:34.280999 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-48e9e295-1bd4-49d4-be8b-1df3ef77b36f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:34.281428 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-48e9e295-1bd4-49d4-be8b-1df3ef77b36f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:34.418675 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-48e9e295-1bd4-49d4-be8b-1df3ef77b36f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:34.425567 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-add59790-4262-4e4e-8eec-d933ee0ccc3e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:34.426450 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-add59790-4262-4e4e-8eec-d933ee0ccc3e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:34.433908 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-add59790-4262-4e4e-8eec-d933ee0ccc3e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:34.438612 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-48e9e295-1bd4-49d4-be8b-1df3ef77b36f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.169731 Jul 14 12:23:34.439175 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-add59790-4262-4e4e-8eec-d933ee0ccc3e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:34.440040 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-add59790-4262-4e4e-8eec-d933ee0ccc3e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:34.440548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-add59790-4262-4e4e-8eec-d933ee0ccc3e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:34.446012 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 363/736] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:34 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:34.583483 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-add59790-4262-4e4e-8eec-d933ee0ccc3e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:34.590970 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-add59790-4262-4e4e-8eec-d933ee0ccc3e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.169216 Jul 14 12:23:34.591544 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 374/737] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:34 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:35.235127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5fb2441d-c77e-4834-8890-23e44ed227d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:35.235776 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5fb2441d-c77e-4834-8890-23e44ed227d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:35.242365 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5fb2441d-c77e-4834-8890-23e44ed227d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:35.242847 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5fb2441d-c77e-4834-8890-23e44ed227d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:35.243610 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5fb2441d-c77e-4834-8890-23e44ed227d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:35.244042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5fb2441d-c77e-4834-8890-23e44ed227d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:35.374096 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5fb2441d-c77e-4834-8890-23e44ed227d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:35.382657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5fb2441d-c77e-4834-8890-23e44ed227d1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1723 microversion: 2.1 time: 0.151356 Jul 14 12:23:35.383246 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 364/738] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:35 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:35.461985 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f0ebd6e3-b28d-4162-8b7e-a9b23f347fca tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:35.462505 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f0ebd6e3-b28d-4162-8b7e-a9b23f347fca tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:35.469077 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0ebd6e3-b28d-4162-8b7e-a9b23f347fca tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:35.469544 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0ebd6e3-b28d-4162-8b7e-a9b23f347fca tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:35.470295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0ebd6e3-b28d-4162-8b7e-a9b23f347fca tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:35.470817 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f0ebd6e3-b28d-4162-8b7e-a9b23f347fca tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:35.600012 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f0ebd6e3-b28d-4162-8b7e-a9b23f347fca tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:35.607805 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f0ebd6e3-b28d-4162-8b7e-a9b23f347fca tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.149880 Jul 14 12:23:35.608057 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d09d0660-e7f5-46cb-acf8-1fdb9744577e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:35.608450 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 375/739] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:35 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:35.608670 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d09d0660-e7f5-46cb-acf8-1fdb9744577e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:35.615353 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d09d0660-e7f5-46cb-acf8-1fdb9744577e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:35.615796 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d09d0660-e7f5-46cb-acf8-1fdb9744577e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:35.616567 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d09d0660-e7f5-46cb-acf8-1fdb9744577e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:35.617000 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d09d0660-e7f5-46cb-acf8-1fdb9744577e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:35.745455 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d09d0660-e7f5-46cb-acf8-1fdb9744577e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:35.752955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d09d0660-e7f5-46cb-acf8-1fdb9744577e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1363 microversion: 2.1 time: 0.148644 Jul 14 12:23:35.753534 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 365/740] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:35 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:36.400114 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-71c0c8a6-0318-422d-8bca-e142b8827cac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:36.400717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-71c0c8a6-0318-422d-8bca-e142b8827cac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:36.406883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-71c0c8a6-0318-422d-8bca-e142b8827cac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:36.407333 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-71c0c8a6-0318-422d-8bca-e142b8827cac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:36.408091 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-71c0c8a6-0318-422d-8bca-e142b8827cac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:36.408525 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-71c0c8a6-0318-422d-8bca-e142b8827cac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:36.541728 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-71c0c8a6-0318-422d-8bca-e142b8827cac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:36.545506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:36.550439 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-71c0c8a6-0318-422d-8bca-e142b8827cac tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1729 microversion: 2.1 time: 0.154266 Jul 14 12:23:36.551034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 376/741] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:36 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:36.567955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d3360e09-8e37-4bd3-bb08-dace44d784bc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:36.568529 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d3360e09-8e37-4bd3-bb08-dace44d784bc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:36.574877 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d3360e09-8e37-4bd3-bb08-dace44d784bc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:36.575321 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d3360e09-8e37-4bd3-bb08-dace44d784bc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:36.576082 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d3360e09-8e37-4bd3-bb08-dace44d784bc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:36.576509 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d3360e09-8e37-4bd3-bb08-dace44d784bc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:36.625388 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-477a1a49-ff82-4cdf-ab35-22aad57bdf5f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:36.625972 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-477a1a49-ff82-4cdf-ab35-22aad57bdf5f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:36.633756 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-477a1a49-ff82-4cdf-ab35-22aad57bdf5f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:36.634299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-477a1a49-ff82-4cdf-ab35-22aad57bdf5f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:36.635182 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-477a1a49-ff82-4cdf-ab35-22aad57bdf5f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:36.635657 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-477a1a49-ff82-4cdf-ab35-22aad57bdf5f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:36.652800 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d3360e09-8e37-4bd3-bb08-dace44d784bc tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089209 Jul 14 12:23:36.653412 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 366/742] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 12:23:36 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:23:36.769775 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8bf4fb39-be57-42b8-8b90-f5787ddbb943 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:36.770250 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-477a1a49-ff82-4cdf-ab35-22aad57bdf5f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:36.771260 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8bf4fb39-be57-42b8-8b90-f5787ddbb943 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:36.782678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8bf4fb39-be57-42b8-8b90-f5787ddbb943 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:36.782678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8bf4fb39-be57-42b8-8b90-f5787ddbb943 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:36.782678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8bf4fb39-be57-42b8-8b90-f5787ddbb943 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:36.782678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8bf4fb39-be57-42b8-8b90-f5787ddbb943 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:36.783238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-477a1a49-ff82-4cdf-ab35-22aad57bdf5f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.158069 Jul 14 12:23:36.783238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 377/743] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:36 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:36.785243 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:37.019875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8bf4fb39-be57-42b8-8b90-f5787ddbb943 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:37.027354 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8bf4fb39-be57-42b8-8b90-f5787ddbb943 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1549 microversion: 2.1 time: 0.261838 Jul 14 12:23:37.027929 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 367/744] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:36 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1549 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:37.045081 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-75b84424-25f3-46cb-8139-6cdf135b2b5e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:37.045494 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-75b84424-25f3-46cb-8139-6cdf135b2b5e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:37.052300 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-75b84424-25f3-46cb-8139-6cdf135b2b5e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:37.052739 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-75b84424-25f3-46cb-8139-6cdf135b2b5e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:37.053501 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-75b84424-25f3-46cb-8139-6cdf135b2b5e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:37.053929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-75b84424-25f3-46cb-8139-6cdf135b2b5e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:37.130729 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-75b84424-25f3-46cb-8139-6cdf135b2b5e tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089894 Jul 14 12:23:37.131363 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 378/745] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 12:23:37 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:37.797182 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5e84ebe1-a38b-466f-b732-c5ff9b45c72c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:37.797798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5e84ebe1-a38b-466f-b732-c5ff9b45c72c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:37.804841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5e84ebe1-a38b-466f-b732-c5ff9b45c72c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:37.805348 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5e84ebe1-a38b-466f-b732-c5ff9b45c72c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:37.806291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5e84ebe1-a38b-466f-b732-c5ff9b45c72c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:37.806899 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5e84ebe1-a38b-466f-b732-c5ff9b45c72c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:37.989170 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-c0aacc42-c85e-4ac3-a065-6342400fbfc1 req-b9f826c7-db39-4f39-ae15-d938556bb16a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158005c6-a074-4abf-a8b8-7c1ee3250b2e", "tag": "ea14a717-a283-4fb9-92a3-043257ce7e6e"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:38.000614 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-c0aacc42-c85e-4ac3-a065-6342400fbfc1 req-b9f826c7-db39-4f39-ae15-d938556bb16a service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:38.001054 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-c0aacc42-c85e-4ac3-a065-6342400fbfc1 req-b9f826c7-db39-4f39-ae15-d938556bb16a service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:38.019725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-c0aacc42-c85e-4ac3-a065-6342400fbfc1 req-b9f826c7-db39-4f39-ae15-d938556bb16a service nova] Creating event network-changed:ea14a717-a283-4fb9-92a3-043257ce7e6e for instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e on hv-cinder-84890 Jul 14 12:23:38.024339 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5e84ebe1-a38b-466f-b732-c5ff9b45c72c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:38.036786 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-c0aacc42-c85e-4ac3-a065-6342400fbfc1 req-b9f826c7-db39-4f39-ae15-d938556bb16a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053088 Jul 14 12:23:38.037532 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5e84ebe1-a38b-466f-b732-c5ff9b45c72c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.244369 Jul 14 12:23:38.038039 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 379/746] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:23:38.048679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 368/747] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:37 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:38.223319 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-9d263d19-e191-4e23-b758-9d8a53026013 req-18bea97b-8b76-40de-97de-3ff9b48a75ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439", "tag": "ee3d4bc1-a084-42b2-91b9-f0df7fc2510b"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:38.232278 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-9d263d19-e191-4e23-b758-9d8a53026013 req-18bea97b-8b76-40de-97de-3ff9b48a75ac service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:38.233113 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-9d263d19-e191-4e23-b758-9d8a53026013 req-18bea97b-8b76-40de-97de-3ff9b48a75ac service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:38.248626 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-9d263d19-e191-4e23-b758-9d8a53026013 req-18bea97b-8b76-40de-97de-3ff9b48a75ac service nova] Creating event network-changed:ee3d4bc1-a084-42b2-91b9-f0df7fc2510b for instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 on hv-cinder-84890 Jul 14 12:23:38.254125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-9d263d19-e191-4e23-b758-9d8a53026013 req-18bea97b-8b76-40de-97de-3ff9b48a75ac service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035731 Jul 14 12:23:38.256357 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 380/748] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:38.716303 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-03e76ae9-5a94-4ed2-a78a-15f343c4419f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:38.716883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-03e76ae9-5a94-4ed2-a78a-15f343c4419f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:38.725875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03e76ae9-5a94-4ed2-a78a-15f343c4419f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:38.726649 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03e76ae9-5a94-4ed2-a78a-15f343c4419f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:38.728190 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03e76ae9-5a94-4ed2-a78a-15f343c4419f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:38.728857 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-03e76ae9-5a94-4ed2-a78a-15f343c4419f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:38.759298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-03e76ae9-5a94-4ed2-a78a-15f343c4419f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Going to try to terminate instance {{(pid=118263) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:23:39.057221 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c0b22959-3109-4336-84f3-5a367896d0b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:39.058007 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c0b22959-3109-4336-84f3-5a367896d0b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:39.064898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c0b22959-3109-4336-84f3-5a367896d0b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:39.065437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c0b22959-3109-4336-84f3-5a367896d0b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:39.066278 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c0b22959-3109-4336-84f3-5a367896d0b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:39.066835 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c0b22959-3109-4336-84f3-5a367896d0b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:39.107710 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-03e76ae9-5a94-4ed2-a78a-15f343c4419f tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 204 len: 0 microversion: 2.1 time: 0.396350 Jul 14 12:23:39.111788 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 369/749] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:23:38 2022] DELETE /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:23:39.119651 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8ecaaee7-d41d-4e30-aa0a-9f991dc1fb6c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:39.120413 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8ecaaee7-d41d-4e30-aa0a-9f991dc1fb6c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:39.126725 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8ecaaee7-d41d-4e30-aa0a-9f991dc1fb6c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:39.127219 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8ecaaee7-d41d-4e30-aa0a-9f991dc1fb6c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:39.128036 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8ecaaee7-d41d-4e30-aa0a-9f991dc1fb6c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:39.128479 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8ecaaee7-d41d-4e30-aa0a-9f991dc1fb6c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:39.225084 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c0b22959-3109-4336-84f3-5a367896d0b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:39.233248 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c0b22959-3109-4336-84f3-5a367896d0b4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.181110 Jul 14 12:23:39.235580 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 381/750] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:39 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:39.299563 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8ecaaee7-d41d-4e30-aa0a-9f991dc1fb6c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:39.307283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8ecaaee7-d41d-4e30-aa0a-9f991dc1fb6c tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1513 microversion: 2.1 time: 0.192320 Jul 14 12:23:39.307867 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 370/751] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:39 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1513 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:40.052571 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-660a78c3-efaa-4a04-962e-f26d2594ef12 req-f0eefe75-0e3e-4fcb-902f-ccaaa5173dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "158005c6-a074-4abf-a8b8-7c1ee3250b2e", "tag": "ea14a717-a283-4fb9-92a3-043257ce7e6e"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:40.060937 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-660a78c3-efaa-4a04-962e-f26d2594ef12 req-f0eefe75-0e3e-4fcb-902f-ccaaa5173dc8 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:40.061492 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-660a78c3-efaa-4a04-962e-f26d2594ef12 req-f0eefe75-0e3e-4fcb-902f-ccaaa5173dc8 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:40.223555 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-660a78c3-efaa-4a04-962e-f26d2594ef12 req-f0eefe75-0e3e-4fcb-902f-ccaaa5173dc8 service nova] Creating event network-changed:ea14a717-a283-4fb9-92a3-043257ce7e6e for instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e on hv-cinder-84890 Jul 14 12:23:40.228377 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-660a78c3-efaa-4a04-962e-f26d2594ef12 req-f0eefe75-0e3e-4fcb-902f-ccaaa5173dc8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180161 Jul 14 12:23:40.228965 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 382/752] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:40.251186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b9d4864f-9593-4280-9f8c-5019d853f421 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:40.251799 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b9d4864f-9593-4280-9f8c-5019d853f421 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:40.258662 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b9d4864f-9593-4280-9f8c-5019d853f421 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:40.259157 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b9d4864f-9593-4280-9f8c-5019d853f421 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:40.259918 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b9d4864f-9593-4280-9f8c-5019d853f421 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:40.260351 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b9d4864f-9593-4280-9f8c-5019d853f421 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:40.325434 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2b04ebbf-a504-4e31-aa91-4fc604b1373e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:40.326106 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2b04ebbf-a504-4e31-aa91-4fc604b1373e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:40.332446 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b04ebbf-a504-4e31-aa91-4fc604b1373e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:40.332910 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b04ebbf-a504-4e31-aa91-4fc604b1373e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:40.333678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b04ebbf-a504-4e31-aa91-4fc604b1373e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:40.334107 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b04ebbf-a504-4e31-aa91-4fc604b1373e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:40.391124 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b9d4864f-9593-4280-9f8c-5019d853f421 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:40.400428 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b9d4864f-9593-4280-9f8c-5019d853f421 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.153015 Jul 14 12:23:40.401014 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 371/753] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:40 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:40.467759 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2b04ebbf-a504-4e31-aa91-4fc604b1373e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:40.475786 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2b04ebbf-a504-4e31-aa91-4fc604b1373e tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1513 microversion: 2.1 time: 0.154677 Jul 14 12:23:40.476349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 383/754] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:40 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:41.416638 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e107442b-0fad-4f80-85f8-fd20d24c4e4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:41.417247 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e107442b-0fad-4f80-85f8-fd20d24c4e4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:41.424049 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e107442b-0fad-4f80-85f8-fd20d24c4e4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:41.424503 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e107442b-0fad-4f80-85f8-fd20d24c4e4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:41.425258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e107442b-0fad-4f80-85f8-fd20d24c4e4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:41.425690 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e107442b-0fad-4f80-85f8-fd20d24c4e4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:41.493232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-177af6be-608c-4c47-befd-6b039cbe1bf5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:41.494037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-177af6be-608c-4c47-befd-6b039cbe1bf5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:41.500789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-177af6be-608c-4c47-befd-6b039cbe1bf5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:41.501332 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-177af6be-608c-4c47-befd-6b039cbe1bf5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:41.502181 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-177af6be-608c-4c47-befd-6b039cbe1bf5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:41.502742 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-177af6be-608c-4c47-befd-6b039cbe1bf5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:41.641548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-177af6be-608c-4c47-befd-6b039cbe1bf5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:41.649519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-177af6be-608c-4c47-befd-6b039cbe1bf5 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1513 microversion: 2.1 time: 0.160136 Jul 14 12:23:41.650098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 384/755] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:41 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:41.723567 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e107442b-0fad-4f80-85f8-fd20d24c4e4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:41.733139 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e107442b-0fad-4f80-85f8-fd20d24c4e4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.320287 Jul 14 12:23:41.733730 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 372/756] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:41 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:42.343169 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-f9972a4e-28d8-4ff2-a80e-5719b1a3afaf req-0124ebe5-c155-427e-918e-1ac57af713bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5c5780a-6bcf-4be9-8453-318344d781a6", "name": "network-vif-deleted", "tag": "c1af4606-a701-43c3-aa36-d3dd1c16d806"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:42.351695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-f9972a4e-28d8-4ff2-a80e-5719b1a3afaf req-0124ebe5-c155-427e-918e-1ac57af713bd service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:42.352140 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-f9972a4e-28d8-4ff2-a80e-5719b1a3afaf req-0124ebe5-c155-427e-918e-1ac57af713bd service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:42.363098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-f9972a4e-28d8-4ff2-a80e-5719b1a3afaf req-0124ebe5-c155-427e-918e-1ac57af713bd service nova] Creating event network-vif-deleted:c1af4606-a701-43c3-aa36-d3dd1c16d806 for instance a5c5780a-6bcf-4be9-8453-318344d781a6 on hv-cinder-84890 Jul 14 12:23:42.368545 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-f9972a4e-28d8-4ff2-a80e-5719b1a3afaf req-0124ebe5-c155-427e-918e-1ac57af713bd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028967 Jul 14 12:23:42.369245 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 385/757] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:23:42.666834 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:42.667435 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:42.674319 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:42.678663 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:42.678663 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:42.678663 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:42.708137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:42.708591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:42.709031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lazy-loading 'fault' on Instance uuid a5c5780a-6bcf-4be9-8453-318344d781a6 {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:23:42.750778 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea504bdceb7b4a1b8109c658e133f955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae52c2cdf124894a541a6b7407eb23c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:42.752851 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ad7f1bbd-2a74-4dd5-a872-f717daf9fa2c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:42.754647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ad7f1bbd-2a74-4dd5-a872-f717daf9fa2c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:42.762915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9edeb3dd-2d62-4b48-b32c-ea62ec04f297 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 200 len: 1309 microversion: 2.1 time: 0.100257 Jul 14 12:23:42.763078 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad7f1bbd-2a74-4dd5-a872-f717daf9fa2c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:42.763546 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad7f1bbd-2a74-4dd5-a872-f717daf9fa2c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:42.764197 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 373/758] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:42 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:42.773683 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad7f1bbd-2a74-4dd5-a872-f717daf9fa2c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:42.774144 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ad7f1bbd-2a74-4dd5-a872-f717daf9fa2c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:42.904004 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ad7f1bbd-2a74-4dd5-a872-f717daf9fa2c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:42.911909 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ad7f1bbd-2a74-4dd5-a872-f717daf9fa2c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.164130 Jul 14 12:23:42.912473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 386/759] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:42 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:43.780451 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-aaadff6d-9f5f-4ee8-b190-1e7fc81227b9 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:43.781102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-aaadff6d-9f5f-4ee8-b190-1e7fc81227b9 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] [instance: a5c5780a-6bcf-4be9-8453-318344d781a6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:43.788657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aaadff6d-9f5f-4ee8-b190-1e7fc81227b9 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:43.789170 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aaadff6d-9f5f-4ee8-b190-1e7fc81227b9 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:43.789955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aaadff6d-9f5f-4ee8-b190-1e7fc81227b9 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:43.790393 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-aaadff6d-9f5f-4ee8-b190-1e7fc81227b9 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:43.804054 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-aaadff6d-9f5f-4ee8-b190-1e7fc81227b9 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] HTTP exception thrown: Instance a5c5780a-6bcf-4be9-8453-318344d781a6 could not be found. Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-aaadff6d-9f5f-4ee8-b190-1e7fc81227b9 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Request method failure captured: Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 HTTP/1.1 Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0ApHzVXZTo1EgiCWTL1R0uUR7AAkn0Qkzas2aK0RaQBvX8rBWM8Y_F7o0EbJLq6yATTfzOTsPDLa2uvzkRWWL6bzvCFhtImSHRjymKL41i2PRWc7cMm4FG0Z_bL500zALjVH6kwaw9yDNT07X4enBj36KTeii856-CINhwL6ZPJgmlY Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: bae52c2cdf124894a541a6b7407eb23c Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-VolumesSnapshotTestJSON-742280967 Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:23:43.805691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bae52c2cdf124894a541a6b7407eb23c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bae52c2cdf124894a541a6b7407eb23c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bae52c2cdf124894a541a6b7407eb23c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bae52c2cdf124894a541a6b7407eb23c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-VolumesSnapshotTestJSON-742280967 Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: bae52c2cdf124894a541a6b7407eb23c Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-742280967 Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-VolumesSnapshotTestJSON-742280967-project Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: ea504bdceb7b4a1b8109c658e133f955 Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-VolumesSnapshotTestJSON-742280967-project Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance a5c5780a-6bcf-4be9-8453-318344d781a6 could not be found. Jul 14 12:23:43.807257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'a5c5780a-6bcf-4be9-8453-318344d781a6'} Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5c5780a-6bcf-4be9-8453-318344d781a6 could not be found. Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:23:43.808153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5c5780a-6bcf-4be9-8453-318344d781a6 could not be found. Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5c5780a-6bcf-4be9-8453-318344d781a6 could not be found. Jul 14 12:23:43.809599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:23:43.810900 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-aaadff6d-9f5f-4ee8-b190-1e7fc81227b9 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] Returning 404 to user: Instance a5c5780a-6bcf-4be9-8453-318344d781a6 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:23:43.810900 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-aaadff6d-9f5f-4ee8-b190-1e7fc81227b9 tempest-VolumesSnapshotTestJSON-742280967 tempest-VolumesSnapshotTestJSON-742280967-project] 10.222.0.27 "GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6" status: 404 len: 111 microversion: 2.1 time: 0.030562 Jul 14 12:23:43.810900 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 374/760] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:43 2022] GET /compute/v2.1/servers/a5c5780a-6bcf-4be9-8453-318344d781a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:23:43.929247 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-61dcf445-bda9-486a-b1e4-e15ce4e6d28f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:43.929957 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-61dcf445-bda9-486a-b1e4-e15ce4e6d28f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:43.936613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-61dcf445-bda9-486a-b1e4-e15ce4e6d28f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:43.945218 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-61dcf445-bda9-486a-b1e4-e15ce4e6d28f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:43.945218 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-61dcf445-bda9-486a-b1e4-e15ce4e6d28f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:43.945218 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-61dcf445-bda9-486a-b1e4-e15ce4e6d28f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:44.072704 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-61dcf445-bda9-486a-b1e4-e15ce4e6d28f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:44.080194 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-61dcf445-bda9-486a-b1e4-e15ce4e6d28f tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.155010 Jul 14 12:23:44.080757 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 387/761] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:43 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:45.098577 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d72e1977-c157-49a4-aaef-21c43a5fdfa2 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:45.099922 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d72e1977-c157-49a4-aaef-21c43a5fdfa2 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:45.101713 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:45.106476 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d72e1977-c157-49a4-aaef-21c43a5fdfa2 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:45.106969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d72e1977-c157-49a4-aaef-21c43a5fdfa2 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:45.108045 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d72e1977-c157-49a4-aaef-21c43a5fdfa2 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:45.108219 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d72e1977-c157-49a4-aaef-21c43a5fdfa2 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:45.237313 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d72e1977-c157-49a4-aaef-21c43a5fdfa2 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:45.245401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d72e1977-c157-49a4-aaef-21c43a5fdfa2 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.151433 Jul 14 12:23:45.245955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 375/762] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:45 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:46.263194 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a123b861-1359-4f25-8f83-7876c7737c35 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:46.263734 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a123b861-1359-4f25-8f83-7876c7737c35 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:46.270914 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a123b861-1359-4f25-8f83-7876c7737c35 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:46.271360 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a123b861-1359-4f25-8f83-7876c7737c35 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:46.272143 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a123b861-1359-4f25-8f83-7876c7737c35 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:46.272569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a123b861-1359-4f25-8f83-7876c7737c35 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:46.402820 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a123b861-1359-4f25-8f83-7876c7737c35 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:46.410366 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a123b861-1359-4f25-8f83-7876c7737c35 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.151160 Jul 14 12:23:46.410962 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 388/763] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:46 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:47.427724 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cd145cc2-c3a0-4457-b73a-ddace049f6c4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:47.428348 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-cd145cc2-c3a0-4457-b73a-ddace049f6c4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:47.434793 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cd145cc2-c3a0-4457-b73a-ddace049f6c4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:47.435249 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cd145cc2-c3a0-4457-b73a-ddace049f6c4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:47.436028 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cd145cc2-c3a0-4457-b73a-ddace049f6c4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:47.436483 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cd145cc2-c3a0-4457-b73a-ddace049f6c4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:47.577821 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-cd145cc2-c3a0-4457-b73a-ddace049f6c4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:47.585858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-cd145cc2-c3a0-4457-b73a-ddace049f6c4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.162231 Jul 14 12:23:47.586425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 376/764] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:47 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:48.603548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-95ed984b-3bbe-43e8-a08c-70412d5aa4a6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:48.604164 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-95ed984b-3bbe-43e8-a08c-70412d5aa4a6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:48.606605 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=66 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:48.611410 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-95ed984b-3bbe-43e8-a08c-70412d5aa4a6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:48.611867 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-95ed984b-3bbe-43e8-a08c-70412d5aa4a6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:48.612658 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-95ed984b-3bbe-43e8-a08c-70412d5aa4a6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:48.613821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-95ed984b-3bbe-43e8-a08c-70412d5aa4a6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:48.744619 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-95ed984b-3bbe-43e8-a08c-70412d5aa4a6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:48.752119 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-95ed984b-3bbe-43e8-a08c-70412d5aa4a6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.152460 Jul 14 12:23:48.752679 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 389/765] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:48 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:48.922134 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a17320fb-0a8c-4173-93fc-34d74c789866 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:48.922700 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a17320fb-0a8c-4173-93fc-34d74c789866 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:48.929090 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a17320fb-0a8c-4173-93fc-34d74c789866 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:48.929541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a17320fb-0a8c-4173-93fc-34d74c789866 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:48.930299 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a17320fb-0a8c-4173-93fc-34d74c789866 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:48.930734 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a17320fb-0a8c-4173-93fc-34d74c789866 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:48.958672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a17320fb-0a8c-4173-93fc-34d74c789866 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments/4c9dec89-4443-40dc-a98a-19eda6392efb" status: 200 len: 194 microversion: 2.20 time: 0.040958 Jul 14 12:23:48.959275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 377/766] 10.222.0.27 () {60 vars in 1453 bytes} [Thu Jul 14 12:23:48 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments/4c9dec89-4443-40dc-a98a-19eda6392efb => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:23:49.022077 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-69074309-1722-4ded-82eb-99bffe725d27 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:49.022563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-69074309-1722-4ded-82eb-99bffe725d27 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:49.028526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-69074309-1722-4ded-82eb-99bffe725d27 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:49.028974 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-69074309-1722-4ded-82eb-99bffe725d27 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:49.029733 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-69074309-1722-4ded-82eb-99bffe725d27 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:49.030167 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-69074309-1722-4ded-82eb-99bffe725d27 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:49.112476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-69074309-1722-4ded-82eb-99bffe725d27 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lazy-loading 'services' on Instance uuid 4d88a179-83e5-4361-8948-8a2632512eaf {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:23:49.342027 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-69074309-1722-4ded-82eb-99bffe725d27 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments/4c9dec89-4443-40dc-a98a-19eda6392efb" status: 202 len: 0 microversion: 2.20 time: 0.324317 Jul 14 12:23:49.342606 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 390/767] 10.222.0.27 () {60 vars in 1456 bytes} [Thu Jul 14 12:23:49 2022] DELETE /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments/4c9dec89-4443-40dc-a98a-19eda6392efb => generated 0 bytes in 326 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:23:49.351291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2feb7922-6f47-48ba-ab85-3bf8cc9dc2c2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:49.352284 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2feb7922-6f47-48ba-ab85-3bf8cc9dc2c2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:49.358393 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2feb7922-6f47-48ba-ab85-3bf8cc9dc2c2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:49.358880 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2feb7922-6f47-48ba-ab85-3bf8cc9dc2c2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:49.359653 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2feb7922-6f47-48ba-ab85-3bf8cc9dc2c2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:49.360120 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2feb7922-6f47-48ba-ab85-3bf8cc9dc2c2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:49.390572 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2feb7922-6f47-48ba-ab85-3bf8cc9dc2c2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043378 Jul 14 12:23:49.391164 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 378/768] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jul 14 12:23:49 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:23:49.771452 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c3976290-3c7d-4b41-81cb-4db587e2538e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:49.772180 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c3976290-3c7d-4b41-81cb-4db587e2538e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:49.779214 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3976290-3c7d-4b41-81cb-4db587e2538e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:49.779668 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3976290-3c7d-4b41-81cb-4db587e2538e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:49.780516 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3976290-3c7d-4b41-81cb-4db587e2538e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:49.780953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c3976290-3c7d-4b41-81cb-4db587e2538e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:49.924902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c3976290-3c7d-4b41-81cb-4db587e2538e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:49.933108 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c3976290-3c7d-4b41-81cb-4db587e2538e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.167155 Jul 14 12:23:49.933675 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 391/769] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:49 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:50.402795 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b83f36b4-b24d-41d7-8ad8-7c3db17764ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:50.403728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b83f36b4-b24d-41d7-8ad8-7c3db17764ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:50.410276 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83f36b4-b24d-41d7-8ad8-7c3db17764ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:50.410718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83f36b4-b24d-41d7-8ad8-7c3db17764ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:50.411513 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83f36b4-b24d-41d7-8ad8-7c3db17764ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:50.412554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b83f36b4-b24d-41d7-8ad8-7c3db17764ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:50.455062 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b83f36b4-b24d-41d7-8ad8-7c3db17764ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056077 Jul 14 12:23:50.457902 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 379/770] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jul 14 12:23:50 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:23:50.950688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3e4af749-d924-4f51-ab02-d43aac7d4a88 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:50.951331 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3e4af749-d924-4f51-ab02-d43aac7d4a88 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:50.957527 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3e4af749-d924-4f51-ab02-d43aac7d4a88 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:50.957967 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3e4af749-d924-4f51-ab02-d43aac7d4a88 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:50.958714 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3e4af749-d924-4f51-ab02-d43aac7d4a88 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:50.959165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3e4af749-d924-4f51-ab02-d43aac7d4a88 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:51.091040 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3e4af749-d924-4f51-ab02-d43aac7d4a88 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:51.098349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3e4af749-d924-4f51-ab02-d43aac7d4a88 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.151522 Jul 14 12:23:51.098951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 392/771] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:50 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:51.467252 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3cd2566e-c949-4ed4-b0ef-ddc9e03fc90f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:51.468191 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3cd2566e-c949-4ed4-b0ef-ddc9e03fc90f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:51.475649 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3cd2566e-c949-4ed4-b0ef-ddc9e03fc90f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:51.476096 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3cd2566e-c949-4ed4-b0ef-ddc9e03fc90f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:51.476851 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3cd2566e-c949-4ed4-b0ef-ddc9e03fc90f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:51.477287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3cd2566e-c949-4ed4-b0ef-ddc9e03fc90f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:51.507535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3cd2566e-c949-4ed4-b0ef-ddc9e03fc90f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044286 Jul 14 12:23:51.508099 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 380/772] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jul 14 12:23:51 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:51.570182 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b5730863-6171-4418-9217-b7cbb5acd248 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:51.570836 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b5730863-6171-4418-9217-b7cbb5acd248 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:51.577068 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b5730863-6171-4418-9217-b7cbb5acd248 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:51.577520 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b5730863-6171-4418-9217-b7cbb5acd248 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:51.578329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b5730863-6171-4418-9217-b7cbb5acd248 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:51.578790 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b5730863-6171-4418-9217-b7cbb5acd248 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:51.605983 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b5730863-6171-4418-9217-b7cbb5acd248 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:23:51.907328 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b5730863-6171-4418-9217-b7cbb5acd248 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 204 len: 0 microversion: 2.20 time: 0.340979 Jul 14 12:23:51.907916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 393/773] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jul 14 12:23:51 2022] DELETE /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 12:23:51.916710 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-6bf787bd-af26-4cda-96f2-bca781839724 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:51.917312 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-6bf787bd-af26-4cda-96f2-bca781839724 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:51.923551 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6bf787bd-af26-4cda-96f2-bca781839724 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:51.924002 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6bf787bd-af26-4cda-96f2-bca781839724 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:51.924762 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6bf787bd-af26-4cda-96f2-bca781839724 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:51.925262 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6bf787bd-af26-4cda-96f2-bca781839724 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:52.052835 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6bf787bd-af26-4cda-96f2-bca781839724 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:52.060693 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6bf787bd-af26-4cda-96f2-bca781839724 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:52.062205 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6bf787bd-af26-4cda-96f2-bca781839724 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:52.063411 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-6bf787bd-af26-4cda-96f2-bca781839724 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.150638 Jul 14 12:23:52.063974 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 381/774] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:23:51 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:23:52.115901 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8d1c9f78-8e8e-45ea-b783-90eedd9c6340 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:52.116615 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8d1c9f78-8e8e-45ea-b783-90eedd9c6340 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:52.123451 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8d1c9f78-8e8e-45ea-b783-90eedd9c6340 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:52.123893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8d1c9f78-8e8e-45ea-b783-90eedd9c6340 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:52.124646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8d1c9f78-8e8e-45ea-b783-90eedd9c6340 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:52.125076 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8d1c9f78-8e8e-45ea-b783-90eedd9c6340 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:52.129697 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:52.256464 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8d1c9f78-8e8e-45ea-b783-90eedd9c6340 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:52.265451 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8d1c9f78-8e8e-45ea-b783-90eedd9c6340 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.153851 Jul 14 12:23:52.266089 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 394/775] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:52 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:53.081643 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e58651c1-a676-4cfb-8ca6-8c9d61b901e1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:53.082365 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e58651c1-a676-4cfb-8ca6-8c9d61b901e1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:53.089076 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e58651c1-a676-4cfb-8ca6-8c9d61b901e1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:53.089531 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e58651c1-a676-4cfb-8ca6-8c9d61b901e1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:53.090293 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e58651c1-a676-4cfb-8ca6-8c9d61b901e1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:53.090730 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e58651c1-a676-4cfb-8ca6-8c9d61b901e1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:53.109684 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:23:53.222787 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e58651c1-a676-4cfb-8ca6-8c9d61b901e1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:53.231426 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e58651c1-a676-4cfb-8ca6-8c9d61b901e1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:53.232958 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e58651c1-a676-4cfb-8ca6-8c9d61b901e1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:53.234114 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e58651c1-a676-4cfb-8ca6-8c9d61b901e1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.156401 Jul 14 12:23:53.234682 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 382/776] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:23:53 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:23:53.284222 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8ae7d6d4-7d66-40d5-a6c8-aa5756e36ab7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:53.285712 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8ae7d6d4-7d66-40d5-a6c8-aa5756e36ab7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:53.292693 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8ae7d6d4-7d66-40d5-a6c8-aa5756e36ab7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:53.293143 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8ae7d6d4-7d66-40d5-a6c8-aa5756e36ab7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:53.294067 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8ae7d6d4-7d66-40d5-a6c8-aa5756e36ab7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:53.295032 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8ae7d6d4-7d66-40d5-a6c8-aa5756e36ab7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:53.438918 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8ae7d6d4-7d66-40d5-a6c8-aa5756e36ab7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:53.446414 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8ae7d6d4-7d66-40d5-a6c8-aa5756e36ab7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.167495 Jul 14 12:23:53.447002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 395/777] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:53 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:54.252786 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-493fa9fd-2e0b-4110-a05a-fad8bdcbbc92 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:54.253949 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-493fa9fd-2e0b-4110-a05a-fad8bdcbbc92 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:54.261549 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-493fa9fd-2e0b-4110-a05a-fad8bdcbbc92 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:54.262005 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-493fa9fd-2e0b-4110-a05a-fad8bdcbbc92 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:54.262788 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-493fa9fd-2e0b-4110-a05a-fad8bdcbbc92 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:54.263240 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-493fa9fd-2e0b-4110-a05a-fad8bdcbbc92 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:54.395193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-493fa9fd-2e0b-4110-a05a-fad8bdcbbc92 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:54.403340 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-493fa9fd-2e0b-4110-a05a-fad8bdcbbc92 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:54.404867 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-493fa9fd-2e0b-4110-a05a-fad8bdcbbc92 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:54.406013 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-493fa9fd-2e0b-4110-a05a-fad8bdcbbc92 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1721 microversion: 2.20 time: 0.157241 Jul 14 12:23:54.406564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 383/778] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:23:54 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:23:54.463872 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f37d2ad7-7d84-47c4-ae4a-310abbbedff4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:54.464512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f37d2ad7-7d84-47c4-ae4a-310abbbedff4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:54.471351 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f37d2ad7-7d84-47c4-ae4a-310abbbedff4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:54.472303 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f37d2ad7-7d84-47c4-ae4a-310abbbedff4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:54.473075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f37d2ad7-7d84-47c4-ae4a-310abbbedff4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:54.473501 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f37d2ad7-7d84-47c4-ae4a-310abbbedff4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:54.617364 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f37d2ad7-7d84-47c4-ae4a-310abbbedff4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:54.627520 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f37d2ad7-7d84-47c4-ae4a-310abbbedff4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.167462 Jul 14 12:23:54.628845 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 396/779] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:54 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:55.425623 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a9829293-cd4b-408f-98b1-dffe328ff629 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:55.426403 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a9829293-cd4b-408f-98b1-dffe328ff629 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:55.433045 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a9829293-cd4b-408f-98b1-dffe328ff629 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:55.433496 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a9829293-cd4b-408f-98b1-dffe328ff629 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:55.434268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a9829293-cd4b-408f-98b1-dffe328ff629 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:55.434704 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a9829293-cd4b-408f-98b1-dffe328ff629 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:55.529974 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a9829293-cd4b-408f-98b1-dffe328ff629 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:55.537896 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a9829293-cd4b-408f-98b1-dffe328ff629 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:55.539449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a9829293-cd4b-408f-98b1-dffe328ff629 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:55.540614 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a9829293-cd4b-408f-98b1-dffe328ff629 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1653 microversion: 2.20 time: 0.119528 Jul 14 12:23:55.541183 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 384/780] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:23:55 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1653 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:23:55.645021 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-df079a2b-e9bb-4668-90a0-3ad038a8dc0e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:55.645637 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-df079a2b-e9bb-4668-90a0-3ad038a8dc0e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:55.654492 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-df079a2b-e9bb-4668-90a0-3ad038a8dc0e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:55.654974 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-df079a2b-e9bb-4668-90a0-3ad038a8dc0e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:55.655753 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-df079a2b-e9bb-4668-90a0-3ad038a8dc0e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:55.656641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-df079a2b-e9bb-4668-90a0-3ad038a8dc0e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:55.739085 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-b044bb01-80ab-40d1-8379-b28f2dc5d4bb req-638bcc2b-032d-4051-acce-2afc6aca3db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d88a179-83e5-4361-8948-8a2632512eaf", "name": "network-vif-deleted", "tag": "0091e22f-2f09-4a5d-9bd6-143e3f69992b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:55.748735 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-b044bb01-80ab-40d1-8379-b28f2dc5d4bb req-638bcc2b-032d-4051-acce-2afc6aca3db0 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:55.749525 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-b044bb01-80ab-40d1-8379-b28f2dc5d4bb req-638bcc2b-032d-4051-acce-2afc6aca3db0 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:55.771686 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-b044bb01-80ab-40d1-8379-b28f2dc5d4bb req-638bcc2b-032d-4051-acce-2afc6aca3db0 service nova] Creating event network-vif-deleted:0091e22f-2f09-4a5d-9bd6-143e3f69992b for instance 4d88a179-83e5-4361-8948-8a2632512eaf on hv-cinder-84890 Jul 14 12:23:55.777624 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-b044bb01-80ab-40d1-8379-b28f2dc5d4bb req-638bcc2b-032d-4051-acce-2afc6aca3db0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132911 Jul 14 12:23:55.778866 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 385/781] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:55.824990 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-df079a2b-e9bb-4668-90a0-3ad038a8dc0e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:55.833792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-df079a2b-e9bb-4668-90a0-3ad038a8dc0e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.192732 Jul 14 12:23:55.834637 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 397/782] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:55 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:56.560275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b58a69bd-307a-4c71-add4-ebe0e8987e76 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:56.560972 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b58a69bd-307a-4c71-add4-ebe0e8987e76 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:56.567868 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b58a69bd-307a-4c71-add4-ebe0e8987e76 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:56.568256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b58a69bd-307a-4c71-add4-ebe0e8987e76 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:56.569021 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b58a69bd-307a-4c71-add4-ebe0e8987e76 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:56.569460 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b58a69bd-307a-4c71-add4-ebe0e8987e76 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:56.785739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b58a69bd-307a-4c71-add4-ebe0e8987e76 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:56.794679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b58a69bd-307a-4c71-add4-ebe0e8987e76 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:56.796226 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b58a69bd-307a-4c71-add4-ebe0e8987e76 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:56.797488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b58a69bd-307a-4c71-add4-ebe0e8987e76 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1653 microversion: 2.20 time: 0.241555 Jul 14 12:23:56.798058 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 386/783] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:23:56 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1653 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:23:56.851654 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0af1f1dd-c02a-4310-93fc-e3073e9985ef tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:56.852301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0af1f1dd-c02a-4310-93fc-e3073e9985ef tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:56.859446 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0af1f1dd-c02a-4310-93fc-e3073e9985ef tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:56.859906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0af1f1dd-c02a-4310-93fc-e3073e9985ef tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:56.860686 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0af1f1dd-c02a-4310-93fc-e3073e9985ef tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:56.861301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0af1f1dd-c02a-4310-93fc-e3073e9985ef tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:56.993163 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0af1f1dd-c02a-4310-93fc-e3073e9985ef tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:57.000877 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0af1f1dd-c02a-4310-93fc-e3073e9985ef tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.153742 Jul 14 12:23:57.001458 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 398/784] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:56 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:57.817461 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ccbd6dad-2276-40e2-bf7d-ae686ca22948 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:57.818112 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ccbd6dad-2276-40e2-bf7d-ae686ca22948 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:57.824637 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ccbd6dad-2276-40e2-bf7d-ae686ca22948 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:57.825086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ccbd6dad-2276-40e2-bf7d-ae686ca22948 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:57.825880 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ccbd6dad-2276-40e2-bf7d-ae686ca22948 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:57.826313 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ccbd6dad-2276-40e2-bf7d-ae686ca22948 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:57.890544 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ccbd6dad-2276-40e2-bf7d-ae686ca22948 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:57.899787 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ccbd6dad-2276-40e2-bf7d-ae686ca22948 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:57.901397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ccbd6dad-2276-40e2-bf7d-ae686ca22948 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:57.902550 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ccbd6dad-2276-40e2-bf7d-ae686ca22948 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1653 microversion: 2.20 time: 0.089942 Jul 14 12:23:57.903149 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 387/785] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:23:57 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1653 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:23:57.995540 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-04670318-8b99-4363-b1e6-e730b8330ded req-98116504-de81-407b-b57c-b9f2f949cda6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905d8954-a633-4e05-a5eb-1bd833799fea", "name": "network-vif-unplugged", "status": "completed", "tag": "97573f11-1cde-45f1-8103-8f5b45ac6f97"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:58.008207 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-04670318-8b99-4363-b1e6-e730b8330ded req-98116504-de81-407b-b57c-b9f2f949cda6 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:58.008701 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-04670318-8b99-4363-b1e6-e730b8330ded req-98116504-de81-407b-b57c-b9f2f949cda6 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:58.019068 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a97cd08e-ac99-460f-b33d-50f520d21423 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:58.019933 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a97cd08e-ac99-460f-b33d-50f520d21423 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:58.021090 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-04670318-8b99-4363-b1e6-e730b8330ded req-98116504-de81-407b-b57c-b9f2f949cda6 service nova] Creating event network-vif-unplugged:97573f11-1cde-45f1-8103-8f5b45ac6f97 for instance 905d8954-a633-4e05-a5eb-1bd833799fea on hv-cinder-84890 Jul 14 12:23:58.026087 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a97cd08e-ac99-460f-b33d-50f520d21423 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:58.026244 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-04670318-8b99-4363-b1e6-e730b8330ded req-98116504-de81-407b-b57c-b9f2f949cda6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034811 Jul 14 12:23:58.026544 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a97cd08e-ac99-460f-b33d-50f520d21423 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:58.027142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 399/786] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:23:58.027350 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a97cd08e-ac99-460f-b33d-50f520d21423 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:58.027775 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a97cd08e-ac99-460f-b33d-50f520d21423 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:58.169834 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a97cd08e-ac99-460f-b33d-50f520d21423 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:58.177583 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a97cd08e-ac99-460f-b33d-50f520d21423 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1565 microversion: 2.1 time: 0.162804 Jul 14 12:23:58.178174 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 388/787] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:58 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1565 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:23:58.200457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-04a7c812-41d1-404a-9793-90652c289591 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:23:58.201161 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-04a7c812-41d1-404a-9793-90652c289591 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:58.208443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04a7c812-41d1-404a-9793-90652c289591 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:58.208897 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04a7c812-41d1-404a-9793-90652c289591 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:58.209667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04a7c812-41d1-404a-9793-90652c289591 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:58.210108 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-04a7c812-41d1-404a-9793-90652c289591 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:58.440964 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-04a7c812-41d1-404a-9793-90652c289591 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "POST /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea/action" status: 202 len: 0 microversion: 2.1 time: 0.244681 Jul 14 12:23:58.441507 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 400/788] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:23:58 2022] POST /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:23:58.449768 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3c4e2c3c-527b-45c3-a56c-08ae144b05cd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:58.450382 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3c4e2c3c-527b-45c3-a56c-08ae144b05cd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:58.457067 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3c4e2c3c-527b-45c3-a56c-08ae144b05cd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:58.457682 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3c4e2c3c-527b-45c3-a56c-08ae144b05cd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:58.458464 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3c4e2c3c-527b-45c3-a56c-08ae144b05cd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:58.458939 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3c4e2c3c-527b-45c3-a56c-08ae144b05cd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:58.592081 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3c4e2c3c-527b-45c3-a56c-08ae144b05cd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:58.600422 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3c4e2c3c-527b-45c3-a56c-08ae144b05cd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1573 microversion: 2.1 time: 0.154581 Jul 14 12:23:58.600981 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 389/789] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:58 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:23:58.922369 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:58.923108 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:58.929841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:58.930824 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:58.931730 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:58.932165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:58.970592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:58.971297 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:58.972855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lazy-loading 'fault' on Instance uuid 4d88a179-83e5-4361-8948-8a2632512eaf {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:23:59.014519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:59.023963 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:59.026736 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:59.026888 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-620eb5f7-503a-44e0-a329-7ecc4b81f352 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 200 len: 1371 microversion: 2.20 time: 0.109880 Jul 14 12:23:59.027827 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 401/790] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:23:58 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 1371 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:23:59.619087 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-47fb9bb1-276e-4256-8bc7-fe8c013429cb tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:23:59.619707 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-47fb9bb1-276e-4256-8bc7-fe8c013429cb tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:23:59.626541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47fb9bb1-276e-4256-8bc7-fe8c013429cb tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:59.627042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47fb9bb1-276e-4256-8bc7-fe8c013429cb tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:59.628482 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47fb9bb1-276e-4256-8bc7-fe8c013429cb tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:23:59.628934 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47fb9bb1-276e-4256-8bc7-fe8c013429cb tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:23:59.761765 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-47fb9bb1-276e-4256-8bc7-fe8c013429cb tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:23:59.769509 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-47fb9bb1-276e-4256-8bc7-fe8c013429cb tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1513 microversion: 2.1 time: 0.155262 Jul 14 12:23:59.770165 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 390/791] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:23:59 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:00.045119 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-801ddb6a-33a8-4a77-b046-14a0d529c924 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:00.045730 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-801ddb6a-33a8-4a77-b046-14a0d529c924 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:00.052313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-801ddb6a-33a8-4a77-b046-14a0d529c924 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:00.052766 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-801ddb6a-33a8-4a77-b046-14a0d529c924 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:00.053544 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-801ddb6a-33a8-4a77-b046-14a0d529c924 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:00.053978 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-801ddb6a-33a8-4a77-b046-14a0d529c924 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:00.067933 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-801ddb6a-33a8-4a77-b046-14a0d529c924 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] HTTP exception thrown: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-801ddb6a-33a8-4a77-b046-14a0d529c924 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Request method failure captured: Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf HTTP/1.1 Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AnpXBrMRIzj9dERuwQuO0tkg8D2X0qXe1xF4tGBtL-5s77dk7eJT2AgDqN8abHwdEgWx40b5cj24YIIyIDP5oItkiZEEgmJqAGU5GdqPRF1OSjh7kzMgtbasf5kTBlowC728qbiigVC1-Om4T6Jtn1HVVBQf-qqT4sev_MvqXP06ss Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:24:00.069592 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51617cc935204a6cba46c6d4d6a24cb3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 15e708082e294dd9a0834ef21ea46fd9 Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:24:00.071116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '4d88a179-83e5-4361-8948-8a2632512eaf'} Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:24:00.072139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:24:00.073678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:00.075473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-801ddb6a-33a8-4a77-b046-14a0d529c924 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Returning 404 to user: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:24:00.075473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-801ddb6a-33a8-4a77-b046-14a0d529c924 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 404 len: 111 microversion: 2.20 time: 0.029997 Jul 14 12:24:00.075473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 402/792] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:00 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 12:24:00.079865 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b79a4a15-e032-4168-acb1-7f956378cbd3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '.version_select at 0x7f0e26475040>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:00.154340 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b79a4a15-e032-4168-acb1-7f956378cbd3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545319440" status: 204 len: 0 microversion: 2.20 time: 0.078219 Jul 14 12:24:00.154935 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 391/793] 10.222.0.27 () {60 vars in 1258 bytes} [Thu Jul 14 12:24:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545319440 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 12:24:00.787036 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c9f50eb4-330d-4a48-9cfe-4fe83218997b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:00.787656 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c9f50eb4-330d-4a48-9cfe-4fe83218997b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:00.793723 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c9f50eb4-330d-4a48-9cfe-4fe83218997b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:00.794428 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c9f50eb4-330d-4a48-9cfe-4fe83218997b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:00.795225 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c9f50eb4-330d-4a48-9cfe-4fe83218997b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:00.795667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c9f50eb4-330d-4a48-9cfe-4fe83218997b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:00.925809 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b952521b-014b-4952-b1fe-956824dfb784 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Action: 'create', calling method: .version_select at 0x7f0e2649f280>, body: {"keypair": {"name": "tempest-keypair-1642957141", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJLhOUD9bIIbCsFaaPwOplSbxfD68NeC2/lJDoBYyxMLiaA16cKTJXRpKD52OxEHv2WWZD0GzALTAluIMYt2kvySMywARY45cE3lETr2Yrd7Tc4x8kSiaM44MZtNScduSg=="}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:00.945299 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-b952521b-014b-4952-b1fe-956824dfb784 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Getting quotas for project 51617cc935204a6cba46c6d4d6a24cb3. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:24:00.949935 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-b952521b-014b-4952-b1fe-956824dfb784 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Getting quotas for user 15e708082e294dd9a0834ef21ea46fd9 and project 51617cc935204a6cba46c6d4d6a24cb3. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:24:01.036081 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b952521b-014b-4952-b1fe-956824dfb784 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.117559 Jul 14 12:24:01.036697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 392/794] 10.222.0.27 () {62 vars in 1199 bytes} [Thu Jul 14 12:24:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 12:24:01.157496 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c9f50eb4-330d-4a48-9cfe-4fe83218997b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:01.162990 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c9f50eb4-330d-4a48-9cfe-4fe83218997b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1515 microversion: 2.1 time: 0.379944 Jul 14 12:24:01.163561 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 403/795] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:00 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1515 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:02.184702 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c3a7151e-553b-4926-864b-abd7b66a3ab9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:02.184702 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c3a7151e-553b-4926-864b-abd7b66a3ab9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:02.189272 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3a7151e-553b-4926-864b-abd7b66a3ab9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:02.189745 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3a7151e-553b-4926-864b-abd7b66a3ab9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:02.190791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3a7151e-553b-4926-864b-abd7b66a3ab9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:02.191238 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3a7151e-553b-4926-864b-abd7b66a3ab9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:02.470912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c3a7151e-553b-4926-864b-abd7b66a3ab9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:02.478710 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c3a7151e-553b-4926-864b-abd7b66a3ab9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.301598 Jul 14 12:24:02.479636 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 393/796] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:02 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:03.495924 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3f34ef3f-b2e4-4431-ae2f-1d2182f209a0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:03.496534 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3f34ef3f-b2e4-4431-ae2f-1d2182f209a0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:03.503823 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f34ef3f-b2e4-4431-ae2f-1d2182f209a0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:03.504271 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f34ef3f-b2e4-4431-ae2f-1d2182f209a0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:03.505597 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f34ef3f-b2e4-4431-ae2f-1d2182f209a0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:03.506073 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f34ef3f-b2e4-4431-ae2f-1d2182f209a0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:03.639695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3f34ef3f-b2e4-4431-ae2f-1d2182f209a0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:03.647926 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3f34ef3f-b2e4-4431-ae2f-1d2182f209a0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.156026 Jul 14 12:24:03.652180 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 404/797] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:03 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:03.709898 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1884180341", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8f1a9939-526e-4b6f-8865-71875a9e9ada"}], "security_groups": [{"name": "tempest-securitygroup--95573376"}], "key_name": "tempest-keypair-1642957141", "user_data": "}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:03.814054 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] validate_networks() for [('8f1a9939-526e-4b6f-8865-71875a9e9ada', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:24:04.239033 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:24:04.239588 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:24:04.240061 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:24:04.240502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:24:04.240914 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:24:04.249723 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:04.250172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:04.251013 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:04.251451 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:04.267483 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Getting quotas for project 51617cc935204a6cba46c6d4d6a24cb3. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:24:04.271622 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Getting quotas for user 15e708082e294dd9a0834ef21ea46fd9 and project 51617cc935204a6cba46c6d4d6a24cb3. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:24:04.282392 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:24:04.285172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:24:04.424127 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-6d059ef8-a0bd-484e-8782-0965325771e6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.719101 Jul 14 12:24:04.424906 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 394/798] 10.222.0.27 () {62 vars in 1187 bytes} [Thu Jul 14 12:24:03 2022] POST /compute/v2.1/servers => generated 400 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 12:24:04.435223 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-982aa3fa-450a-4560-9ba6-42aec19a3c68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:04.435836 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-982aa3fa-450a-4560-9ba6-42aec19a3c68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:04.496863 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-982aa3fa-450a-4560-9ba6-42aec19a3c68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:04.506403 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-982aa3fa-450a-4560-9ba6-42aec19a3c68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:04.507970 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-982aa3fa-450a-4560-9ba6-42aec19a3c68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:04.509125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-982aa3fa-450a-4560-9ba6-42aec19a3c68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1282 microversion: 2.20 time: 0.078056 Jul 14 12:24:04.510661 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 405/799] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:04 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:24:04.667405 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-6120a0b1-239d-4206-9383-a0e291e57aa4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:04.668018 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-6120a0b1-239d-4206-9383-a0e291e57aa4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:04.675231 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6120a0b1-239d-4206-9383-a0e291e57aa4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:04.675751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6120a0b1-239d-4206-9383-a0e291e57aa4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:04.676530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6120a0b1-239d-4206-9383-a0e291e57aa4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:04.677004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6120a0b1-239d-4206-9383-a0e291e57aa4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:04.812494 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6120a0b1-239d-4206-9383-a0e291e57aa4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:04.820833 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-6120a0b1-239d-4206-9383-a0e291e57aa4 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.157318 Jul 14 12:24:04.821403 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 395/800] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:04 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:05.528637 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a1f89a43-dac5-4822-b50f-eb89a35617a8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:05.529442 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a1f89a43-dac5-4822-b50f-eb89a35617a8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:05.537608 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a1f89a43-dac5-4822-b50f-eb89a35617a8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:05.538818 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a1f89a43-dac5-4822-b50f-eb89a35617a8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:05.538963 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a1f89a43-dac5-4822-b50f-eb89a35617a8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:05.539388 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a1f89a43-dac5-4822-b50f-eb89a35617a8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:05.599532 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a1f89a43-dac5-4822-b50f-eb89a35617a8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:05.607740 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a1f89a43-dac5-4822-b50f-eb89a35617a8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:05.609393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a1f89a43-dac5-4822-b50f-eb89a35617a8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:05.610518 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a1f89a43-dac5-4822-b50f-eb89a35617a8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1278 microversion: 2.20 time: 0.086145 Jul 14 12:24:05.611194 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 406/801] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:05 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:05.838173 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7fdd3af8-77fc-4f7b-906c-e6bfbd6c28be tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:05.838827 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7fdd3af8-77fc-4f7b-906c-e6bfbd6c28be tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:05.845465 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7fdd3af8-77fc-4f7b-906c-e6bfbd6c28be tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:05.845914 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7fdd3af8-77fc-4f7b-906c-e6bfbd6c28be tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:05.847265 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7fdd3af8-77fc-4f7b-906c-e6bfbd6c28be tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:05.847708 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7fdd3af8-77fc-4f7b-906c-e6bfbd6c28be tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:05.983200 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7fdd3af8-77fc-4f7b-906c-e6bfbd6c28be tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:05.991125 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7fdd3af8-77fc-4f7b-906c-e6bfbd6c28be tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.157262 Jul 14 12:24:05.991699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 396/802] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:05 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:06.629929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-218ee67c-eca6-42b0-93d0-f8c3ee2103c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:06.630527 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-218ee67c-eca6-42b0-93d0-f8c3ee2103c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:06.636960 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-218ee67c-eca6-42b0-93d0-f8c3ee2103c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:06.637406 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-218ee67c-eca6-42b0-93d0-f8c3ee2103c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:06.638162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-218ee67c-eca6-42b0-93d0-f8c3ee2103c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:06.638591 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-218ee67c-eca6-42b0-93d0-f8c3ee2103c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:06.702604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-218ee67c-eca6-42b0-93d0-f8c3ee2103c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:06.711248 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-218ee67c-eca6-42b0-93d0-f8c3ee2103c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:06.712738 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-218ee67c-eca6-42b0-93d0-f8c3ee2103c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:06.713836 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-218ee67c-eca6-42b0-93d0-f8c3ee2103c0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1342 microversion: 2.20 time: 0.088368 Jul 14 12:24:06.714382 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 407/803] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:06 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1342 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:07.008383 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9b6e874c-c2ce-4496-8f3e-e66f694dacc7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:07.008987 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9b6e874c-c2ce-4496-8f3e-e66f694dacc7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:07.015247 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9b6e874c-c2ce-4496-8f3e-e66f694dacc7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:07.016018 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9b6e874c-c2ce-4496-8f3e-e66f694dacc7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:07.016808 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9b6e874c-c2ce-4496-8f3e-e66f694dacc7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:07.017244 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9b6e874c-c2ce-4496-8f3e-e66f694dacc7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:07.422039 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9b6e874c-c2ce-4496-8f3e-e66f694dacc7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:07.430027 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9b6e874c-c2ce-4496-8f3e-e66f694dacc7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.425708 Jul 14 12:24:07.430600 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 397/804] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:07 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:07.733700 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d45c8def-7cb3-4477-9308-c2bfe5064f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:07.734335 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d45c8def-7cb3-4477-9308-c2bfe5064f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:07.742368 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d45c8def-7cb3-4477-9308-c2bfe5064f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:07.742905 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d45c8def-7cb3-4477-9308-c2bfe5064f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:07.743779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d45c8def-7cb3-4477-9308-c2bfe5064f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:07.744400 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d45c8def-7cb3-4477-9308-c2bfe5064f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:07.895484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d45c8def-7cb3-4477-9308-c2bfe5064f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:07.903583 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d45c8def-7cb3-4477-9308-c2bfe5064f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:07.905146 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d45c8def-7cb3-4477-9308-c2bfe5064f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:07.906251 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d45c8def-7cb3-4477-9308-c2bfe5064f42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.176866 Jul 14 12:24:07.906863 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 408/805] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:07 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:08.450982 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5ba6e0ba-a829-413d-872d-1220d987d6c7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:08.450982 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5ba6e0ba-a829-413d-872d-1220d987d6c7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:08.457915 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-3db83497-b7a4-4ec4-8ed2-d62c1dc400d1 req-29dab0c4-3537-4d9f-a8bf-ac3605666f13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a356720e-5371-4d02-bd6d-5293e39ed68a", "tag": "3c14bf32-ee21-46df-a087-dc33eef08a69"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:08.466475 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5ba6e0ba-a829-413d-872d-1220d987d6c7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:08.467165 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5ba6e0ba-a829-413d-872d-1220d987d6c7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:08.468163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5ba6e0ba-a829-413d-872d-1220d987d6c7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:08.468745 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5ba6e0ba-a829-413d-872d-1220d987d6c7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:08.469492 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-3db83497-b7a4-4ec4-8ed2-d62c1dc400d1 req-29dab0c4-3537-4d9f-a8bf-ac3605666f13 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:08.469951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-3db83497-b7a4-4ec4-8ed2-d62c1dc400d1 req-29dab0c4-3537-4d9f-a8bf-ac3605666f13 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:08.492791 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-3db83497-b7a4-4ec4-8ed2-d62c1dc400d1 req-29dab0c4-3537-4d9f-a8bf-ac3605666f13 service nova] Creating event network-changed:3c14bf32-ee21-46df-a087-dc33eef08a69 for instance a356720e-5371-4d02-bd6d-5293e39ed68a on hv-cinder-84890 Jul 14 12:24:08.497832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-3db83497-b7a4-4ec4-8ed2-d62c1dc400d1 req-29dab0c4-3537-4d9f-a8bf-ac3605666f13 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044214 Jul 14 12:24:08.502292 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 409/806] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:08.694305 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5ba6e0ba-a829-413d-872d-1220d987d6c7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:08.702493 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5ba6e0ba-a829-413d-872d-1220d987d6c7 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.259054 Jul 14 12:24:08.703114 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 398/807] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:08 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:08.930190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c6ee5996-2c00-4de6-acc9-111c355b3ca2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:08.930964 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c6ee5996-2c00-4de6-acc9-111c355b3ca2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:08.937231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6ee5996-2c00-4de6-acc9-111c355b3ca2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:08.937684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6ee5996-2c00-4de6-acc9-111c355b3ca2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:08.938457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6ee5996-2c00-4de6-acc9-111c355b3ca2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:08.938921 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6ee5996-2c00-4de6-acc9-111c355b3ca2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:09.068789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c6ee5996-2c00-4de6-acc9-111c355b3ca2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:09.076759 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c6ee5996-2c00-4de6-acc9-111c355b3ca2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:09.078269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c6ee5996-2c00-4de6-acc9-111c355b3ca2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:09.079392 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c6ee5996-2c00-4de6-acc9-111c355b3ca2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.154151 Jul 14 12:24:09.079957 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 410/808] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:08 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:09.722194 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-efe9246b-0378-4022-9bc8-3ec4fc279a75 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:09.723023 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-efe9246b-0378-4022-9bc8-3ec4fc279a75 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:09.731793 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efe9246b-0378-4022-9bc8-3ec4fc279a75 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:09.732247 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efe9246b-0378-4022-9bc8-3ec4fc279a75 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:09.733038 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efe9246b-0378-4022-9bc8-3ec4fc279a75 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:09.733479 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efe9246b-0378-4022-9bc8-3ec4fc279a75 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:10.006677 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-efe9246b-0378-4022-9bc8-3ec4fc279a75 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:10.014643 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-efe9246b-0378-4022-9bc8-3ec4fc279a75 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.297147 Jul 14 12:24:10.015487 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 399/809] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:09 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:10.098855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4530f11f-7042-49d6-beb4-f36ff4198626 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:10.100309 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4530f11f-7042-49d6-beb4-f36ff4198626 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:10.108600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4530f11f-7042-49d6-beb4-f36ff4198626 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:10.109367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4530f11f-7042-49d6-beb4-f36ff4198626 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:10.110482 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4530f11f-7042-49d6-beb4-f36ff4198626 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:10.110609 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4530f11f-7042-49d6-beb4-f36ff4198626 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:10.359022 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4530f11f-7042-49d6-beb4-f36ff4198626 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:10.367589 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4530f11f-7042-49d6-beb4-f36ff4198626 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:10.369178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4530f11f-7042-49d6-beb4-f36ff4198626 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:10.372548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4530f11f-7042-49d6-beb4-f36ff4198626 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.276797 Jul 14 12:24:10.372548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 411/810] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:10 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:11.032535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5cbdcd24-66e7-4061-b200-166667519833 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:11.033174 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5cbdcd24-66e7-4061-b200-166667519833 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:11.040113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5cbdcd24-66e7-4061-b200-166667519833 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:11.040558 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5cbdcd24-66e7-4061-b200-166667519833 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:11.041315 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5cbdcd24-66e7-4061-b200-166667519833 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:11.041748 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5cbdcd24-66e7-4061-b200-166667519833 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:11.182399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5cbdcd24-66e7-4061-b200-166667519833 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:11.189863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5cbdcd24-66e7-4061-b200-166667519833 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.161379 Jul 14 12:24:11.190694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 400/811] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:11 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:11.388276 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-28b58541-4456-4706-ab11-c82bb06300d6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:11.388890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-28b58541-4456-4706-ab11-c82bb06300d6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:11.395956 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-28b58541-4456-4706-ab11-c82bb06300d6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:11.396417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-28b58541-4456-4706-ab11-c82bb06300d6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:11.397192 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-28b58541-4456-4706-ab11-c82bb06300d6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:11.397634 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-28b58541-4456-4706-ab11-c82bb06300d6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:11.422081 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:11.539572 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-28b58541-4456-4706-ab11-c82bb06300d6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:11.551217 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-28b58541-4456-4706-ab11-c82bb06300d6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:11.553065 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-28b58541-4456-4706-ab11-c82bb06300d6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:11.554581 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-28b58541-4456-4706-ab11-c82bb06300d6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.169701 Jul 14 12:24:11.555107 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 412/812] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:11 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:12.206881 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-40f07b3b-e9b1-4fc3-90eb-f0991b64a2f5 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:12.207641 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-40f07b3b-e9b1-4fc3-90eb-f0991b64a2f5 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:12.215314 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-40f07b3b-e9b1-4fc3-90eb-f0991b64a2f5 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:12.220602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-40f07b3b-e9b1-4fc3-90eb-f0991b64a2f5 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:12.220602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-40f07b3b-e9b1-4fc3-90eb-f0991b64a2f5 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:12.220602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-40f07b3b-e9b1-4fc3-90eb-f0991b64a2f5 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:12.356282 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-40f07b3b-e9b1-4fc3-90eb-f0991b64a2f5 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:12.364682 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-40f07b3b-e9b1-4fc3-90eb-f0991b64a2f5 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.161660 Jul 14 12:24:12.365342 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 401/813] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:12 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:12.572759 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fc772fe5-206d-4e44-b987-da67b8e9c45a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:12.573372 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fc772fe5-206d-4e44-b987-da67b8e9c45a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:12.579979 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc772fe5-206d-4e44-b987-da67b8e9c45a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:12.581001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc772fe5-206d-4e44-b987-da67b8e9c45a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:12.581920 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc772fe5-206d-4e44-b987-da67b8e9c45a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:12.582363 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc772fe5-206d-4e44-b987-da67b8e9c45a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:12.719295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-fc772fe5-206d-4e44-b987-da67b8e9c45a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:12.727900 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-fc772fe5-206d-4e44-b987-da67b8e9c45a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:12.730492 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-fc772fe5-206d-4e44-b987-da67b8e9c45a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:12.731838 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fc772fe5-206d-4e44-b987-da67b8e9c45a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.162950 Jul 14 12:24:12.732415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 413/814] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:12 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:13.382414 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-af6f6bca-3835-4dae-877c-ec68d78af1f6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:13.383050 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-af6f6bca-3835-4dae-877c-ec68d78af1f6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:13.389477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-af6f6bca-3835-4dae-877c-ec68d78af1f6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:13.389927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-af6f6bca-3835-4dae-877c-ec68d78af1f6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:13.390688 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-af6f6bca-3835-4dae-877c-ec68d78af1f6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:13.391146 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-af6f6bca-3835-4dae-877c-ec68d78af1f6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:13.409624 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:13.425832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b5a054cb-c46c-4c71-802d-4898eef37f24 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2002398843"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:13.426374 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b5a054cb-c46c-4c71-802d-4898eef37f24 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:13.432532 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b5a054cb-c46c-4c71-802d-4898eef37f24 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:13.432988 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b5a054cb-c46c-4c71-802d-4898eef37f24 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:13.433787 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b5a054cb-c46c-4c71-802d-4898eef37f24 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:13.434312 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b5a054cb-c46c-4c71-802d-4898eef37f24 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:13.524111 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-af6f6bca-3835-4dae-877c-ec68d78af1f6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:13.531922 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-af6f6bca-3835-4dae-877c-ec68d78af1f6 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.153246 Jul 14 12:24:13.532449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 402/815] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:13 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:24:13.565320 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.network.security_group_api [None req-b5a054cb-c46c-4c71-802d-4898eef37f24 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Removing security group 6e316a0d-e175-4a0e-b542-f87e0ab50f92 from port 8d1d4c31-5832-429c-8506-0433ac2a974b Jul 14 12:24:13.749712 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7a7be217-7337-4d32-9ae3-ac6440d3df42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:13.750512 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7a7be217-7337-4d32-9ae3-ac6440d3df42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:13.757353 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7a7be217-7337-4d32-9ae3-ac6440d3df42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:13.757806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7a7be217-7337-4d32-9ae3-ac6440d3df42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:13.758586 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7a7be217-7337-4d32-9ae3-ac6440d3df42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:13.759053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7a7be217-7337-4d32-9ae3-ac6440d3df42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:13.892963 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7a7be217-7337-4d32-9ae3-ac6440d3df42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:13.900898 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7a7be217-7337-4d32-9ae3-ac6440d3df42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:13.902390 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7a7be217-7337-4d32-9ae3-ac6440d3df42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:13.903507 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7a7be217-7337-4d32-9ae3-ac6440d3df42 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.157850 Jul 14 12:24:13.904201 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 403/816] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:13 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:24:14.026043 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b5a054cb-c46c-4c71-802d-4898eef37f24 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "POST /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/action" status: 202 len: 0 microversion: 2.1 time: 0.604479 Jul 14 12:24:14.027500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 414/817] 10.222.0.27 () {60 vars in 1277 bytes} [Thu Jul 14 12:24:13 2022] POST /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 12:24:14.191325 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-76cd40db-a98a-47f7-b801-b0d776203e25 req-6dd72d2b-d1bc-4959-90e4-0a93a34d405d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357e6fda-615e-4e1a-9f33-552398705e3e", "tag": "8d1d4c31-5832-429c-8506-0433ac2a974b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:14.200102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-76cd40db-a98a-47f7-b801-b0d776203e25 req-6dd72d2b-d1bc-4959-90e4-0a93a34d405d service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:14.200543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-76cd40db-a98a-47f7-b801-b0d776203e25 req-6dd72d2b-d1bc-4959-90e4-0a93a34d405d service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:14.226628 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-76cd40db-a98a-47f7-b801-b0d776203e25 req-6dd72d2b-d1bc-4959-90e4-0a93a34d405d service nova] Creating event network-changed:8d1d4c31-5832-429c-8506-0433ac2a974b for instance 357e6fda-615e-4e1a-9f33-552398705e3e on hv-cinder-84890 Jul 14 12:24:14.253485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-76cd40db-a98a-47f7-b801-b0d776203e25 req-6dd72d2b-d1bc-4959-90e4-0a93a34d405d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220384 Jul 14 12:24:14.255026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 404/818] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:14.501899 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:14.530068 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-2674ebc0-1aa1-42fb-ad97-fd3130006762 req-203188b4-1701-4399-8fca-a11dc8fcf07e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905d8954-a633-4e05-a5eb-1bd833799fea", "name": "network-vif-plugged", "status": "completed", "tag": "97573f11-1cde-45f1-8103-8f5b45ac6f97"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:14.543817 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-2674ebc0-1aa1-42fb-ad97-fd3130006762 req-203188b4-1701-4399-8fca-a11dc8fcf07e service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:14.549880 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-2674ebc0-1aa1-42fb-ad97-fd3130006762 req-203188b4-1701-4399-8fca-a11dc8fcf07e service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:14.550048 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:14.550048 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=10 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:14.555916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d319e85c-3596-48ba-b38f-0e61efce6115 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:14.556920 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d319e85c-3596-48ba-b38f-0e61efce6115 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:14.560926 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-2674ebc0-1aa1-42fb-ad97-fd3130006762 req-203188b4-1701-4399-8fca-a11dc8fcf07e service nova] Creating event network-vif-plugged:97573f11-1cde-45f1-8103-8f5b45ac6f97 for instance 905d8954-a633-4e05-a5eb-1bd833799fea on hv-cinder-84890 Jul 14 12:24:14.566997 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d319e85c-3596-48ba-b38f-0e61efce6115 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:14.568611 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-2674ebc0-1aa1-42fb-ad97-fd3130006762 req-203188b4-1701-4399-8fca-a11dc8fcf07e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134410 Jul 14 12:24:14.569512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 415/819] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:24:14.572831 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d319e85c-3596-48ba-b38f-0e61efce6115 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:14.572831 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d319e85c-3596-48ba-b38f-0e61efce6115 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:14.572831 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d319e85c-3596-48ba-b38f-0e61efce6115 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:14.915272 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d319e85c-3596-48ba-b38f-0e61efce6115 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:14.925152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d319e85c-3596-48ba-b38f-0e61efce6115 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.378666 Jul 14 12:24:14.925928 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 405/820] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:14 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:24:14.928573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f07f3603-6fdb-4f72-8396-64ab8eda003a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:14.929416 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f07f3603-6fdb-4f72-8396-64ab8eda003a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:14.937625 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f07f3603-6fdb-4f72-8396-64ab8eda003a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:14.938437 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f07f3603-6fdb-4f72-8396-64ab8eda003a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:14.940132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f07f3603-6fdb-4f72-8396-64ab8eda003a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:14.940656 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f07f3603-6fdb-4f72-8396-64ab8eda003a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:15.082052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f07f3603-6fdb-4f72-8396-64ab8eda003a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:15.090828 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f07f3603-6fdb-4f72-8396-64ab8eda003a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:15.092347 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f07f3603-6fdb-4f72-8396-64ab8eda003a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:15.093482 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f07f3603-6fdb-4f72-8396-64ab8eda003a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.175261 Jul 14 12:24:15.094220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 416/821] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:14 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:24:15.944137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b637947d-373b-439a-a326-e0407948b65d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:15.945996 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b637947d-373b-439a-a326-e0407948b65d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:15.949781 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:15.954363 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b637947d-373b-439a-a326-e0407948b65d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:15.955357 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b637947d-373b-439a-a326-e0407948b65d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:15.956215 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b637947d-373b-439a-a326-e0407948b65d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:15.956646 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b637947d-373b-439a-a326-e0407948b65d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:16.050307 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fb01b055-6c57-4728-aadc-29413e78ddd1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:16.050903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fb01b055-6c57-4728-aadc-29413e78ddd1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:16.057628 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fb01b055-6c57-4728-aadc-29413e78ddd1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:16.058141 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fb01b055-6c57-4728-aadc-29413e78ddd1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:16.059047 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fb01b055-6c57-4728-aadc-29413e78ddd1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:16.059657 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fb01b055-6c57-4728-aadc-29413e78ddd1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:16.124371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b637947d-373b-439a-a326-e0407948b65d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:16.134922 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b637947d-373b-439a-a326-e0407948b65d tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.195913 Jul 14 12:24:16.146863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 406/822] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:15 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:16.147210 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-fb01b055-6c57-4728-aadc-29413e78ddd1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lazy-loading 'services' on Instance uuid 357e6fda-615e-4e1a-9f33-552398705e3e {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:24:16.151697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-9286c4a8-e34c-48ea-aff1-052966dcc51a req-79aa8c2b-d9bb-4252-839d-8fe387d00294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "357e6fda-615e-4e1a-9f33-552398705e3e", "tag": "8d1d4c31-5832-429c-8506-0433ac2a974b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:16.160330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-9286c4a8-e34c-48ea-aff1-052966dcc51a req-79aa8c2b-d9bb-4252-839d-8fe387d00294 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:16.161030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-9286c4a8-e34c-48ea-aff1-052966dcc51a req-79aa8c2b-d9bb-4252-839d-8fe387d00294 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:16.172652 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-9286c4a8-e34c-48ea-aff1-052966dcc51a req-79aa8c2b-d9bb-4252-839d-8fe387d00294 service nova] Creating event network-changed:8d1d4c31-5832-429c-8506-0433ac2a974b for instance 357e6fda-615e-4e1a-9f33-552398705e3e on hv-cinder-84890 Jul 14 12:24:16.177992 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-9286c4a8-e34c-48ea-aff1-052966dcc51a req-79aa8c2b-d9bb-4252-839d-8fe387d00294 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029895 Jul 14 12:24:16.178596 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 407/823] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:16.183515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4abdade2-8955-4c90-a46e-f0cd330b94e4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:16.184211 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4abdade2-8955-4c90-a46e-f0cd330b94e4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:16.191887 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4abdade2-8955-4c90-a46e-f0cd330b94e4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:16.192342 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4abdade2-8955-4c90-a46e-f0cd330b94e4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:16.193121 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4abdade2-8955-4c90-a46e-f0cd330b94e4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:16.193564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4abdade2-8955-4c90-a46e-f0cd330b94e4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:16.337671 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4abdade2-8955-4c90-a46e-f0cd330b94e4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:16.346113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4abdade2-8955-4c90-a46e-f0cd330b94e4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:16.347987 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4abdade2-8955-4c90-a46e-f0cd330b94e4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:16.349090 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4abdade2-8955-4c90-a46e-f0cd330b94e4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.169421 Jul 14 12:24:16.349644 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 408/824] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:16 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:16.358234 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fb01b055-6c57-4728-aadc-29413e78ddd1 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "DELETE /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments/dc365573-26bb-4d0e-a240-59272046a3d1" status: 202 len: 0 microversion: 2.1 time: 0.312000 Jul 14 12:24:16.358996 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 417/825] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:24:16 2022] DELETE /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments/dc365573-26bb-4d0e-a240-59272046a3d1 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 12:24:16.367823 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0bbdc3f5-753b-4ecd-be15-ef1ec0a3361e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:16.368740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0bbdc3f5-753b-4ecd-be15-ef1ec0a3361e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:16.374814 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0bbdc3f5-753b-4ecd-be15-ef1ec0a3361e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:16.375246 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0bbdc3f5-753b-4ecd-be15-ef1ec0a3361e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:16.376004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0bbdc3f5-753b-4ecd-be15-ef1ec0a3361e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:16.376433 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0bbdc3f5-753b-4ecd-be15-ef1ec0a3361e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:16.404980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0bbdc3f5-753b-4ecd-be15-ef1ec0a3361e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040971 Jul 14 12:24:16.405541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 409/826] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:16 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:24:17.153953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c8ae9254-00b1-499d-ac70-2bcbfa4d6929 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:17.154570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c8ae9254-00b1-499d-ac70-2bcbfa4d6929 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:17.161006 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c8ae9254-00b1-499d-ac70-2bcbfa4d6929 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:17.161461 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c8ae9254-00b1-499d-ac70-2bcbfa4d6929 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:17.162230 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c8ae9254-00b1-499d-ac70-2bcbfa4d6929 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:17.162672 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c8ae9254-00b1-499d-ac70-2bcbfa4d6929 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:17.291677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c8ae9254-00b1-499d-ac70-2bcbfa4d6929 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:17.300034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c8ae9254-00b1-499d-ac70-2bcbfa4d6929 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.150861 Jul 14 12:24:17.300611 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 418/827] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:17 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:17.367431 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0a374313-f9d8-4fbb-bc4b-082227189385 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:17.368032 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0a374313-f9d8-4fbb-bc4b-082227189385 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:17.373950 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0a374313-f9d8-4fbb-bc4b-082227189385 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:17.374388 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0a374313-f9d8-4fbb-bc4b-082227189385 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:17.375158 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0a374313-f9d8-4fbb-bc4b-082227189385 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:17.375593 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0a374313-f9d8-4fbb-bc4b-082227189385 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:17.417431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d92065b1-e446-40c0-a34e-8a933b629dbc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:17.418323 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d92065b1-e446-40c0-a34e-8a933b629dbc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:17.425304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d92065b1-e446-40c0-a34e-8a933b629dbc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:17.425745 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d92065b1-e446-40c0-a34e-8a933b629dbc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:17.426506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d92065b1-e446-40c0-a34e-8a933b629dbc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:17.426962 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d92065b1-e446-40c0-a34e-8a933b629dbc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:17.456284 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d92065b1-e446-40c0-a34e-8a933b629dbc tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042755 Jul 14 12:24:17.456839 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 419/828] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:17 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:24:17.504705 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0a374313-f9d8-4fbb-bc4b-082227189385 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:17.512671 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0a374313-f9d8-4fbb-bc4b-082227189385 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:17.514173 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0a374313-f9d8-4fbb-bc4b-082227189385 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:17.515314 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0a374313-f9d8-4fbb-bc4b-082227189385 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.151846 Jul 14 12:24:17.515873 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 410/829] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:17 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:18.316981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-49fcb4ce-cf41-4f53-ae74-f97d5a9dcdab tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:18.317596 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-49fcb4ce-cf41-4f53-ae74-f97d5a9dcdab tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:18.324175 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-49fcb4ce-cf41-4f53-ae74-f97d5a9dcdab tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:18.327512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-49fcb4ce-cf41-4f53-ae74-f97d5a9dcdab tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:18.327512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-49fcb4ce-cf41-4f53-ae74-f97d5a9dcdab tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:18.327512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-49fcb4ce-cf41-4f53-ae74-f97d5a9dcdab tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:18.456908 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-49fcb4ce-cf41-4f53-ae74-f97d5a9dcdab tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:18.464411 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-49fcb4ce-cf41-4f53-ae74-f97d5a9dcdab tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.152103 Jul 14 12:24:18.464986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 420/830] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:18 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:18.467903 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-518e4dfa-a04b-44d5-805e-5c5daa01ed40 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:18.468816 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-518e4dfa-a04b-44d5-805e-5c5daa01ed40 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:18.475216 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-518e4dfa-a04b-44d5-805e-5c5daa01ed40 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:18.475678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-518e4dfa-a04b-44d5-805e-5c5daa01ed40 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:18.476414 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-518e4dfa-a04b-44d5-805e-5c5daa01ed40 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:18.476842 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-518e4dfa-a04b-44d5-805e-5c5daa01ed40 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:18.504955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-518e4dfa-a04b-44d5-805e-5c5daa01ed40 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041075 Jul 14 12:24:18.505504 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 411/831] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:18 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:24:18.533016 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5417d223-aa51-45fd-9074-377aeb174d01 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:18.533705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5417d223-aa51-45fd-9074-377aeb174d01 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:18.539725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5417d223-aa51-45fd-9074-377aeb174d01 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:18.540176 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5417d223-aa51-45fd-9074-377aeb174d01 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:18.540965 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5417d223-aa51-45fd-9074-377aeb174d01 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:18.541406 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5417d223-aa51-45fd-9074-377aeb174d01 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:18.674637 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5417d223-aa51-45fd-9074-377aeb174d01 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:18.682982 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5417d223-aa51-45fd-9074-377aeb174d01 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:18.685282 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5417d223-aa51-45fd-9074-377aeb174d01 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:18.685966 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5417d223-aa51-45fd-9074-377aeb174d01 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.157019 Jul 14 12:24:18.686701 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 421/832] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:18 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:19.002734 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-79933b73-923e-44a8-b585-7bc6c29e9444 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:19.003264 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-79933b73-923e-44a8-b585-7bc6c29e9444 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:19.009265 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-79933b73-923e-44a8-b585-7bc6c29e9444 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:19.010097 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-79933b73-923e-44a8-b585-7bc6c29e9444 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:19.010903 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-79933b73-923e-44a8-b585-7bc6c29e9444 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:19.011379 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-79933b73-923e-44a8-b585-7bc6c29e9444 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:19.093086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-79933b73-923e-44a8-b585-7bc6c29e9444 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lazy-loading 'services' on Instance uuid 158005c6-a074-4abf-a8b8-7c1ee3250b2e {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:24:19.290292 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-79933b73-923e-44a8-b585-7bc6c29e9444 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments/7d220846-5fa5-4e50-a7be-6501e3f67291" status: 202 len: 0 microversion: 2.1 time: 0.292543 Jul 14 12:24:19.290919 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 412/833] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:24:18 2022] DELETE /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments/7d220846-5fa5-4e50-a7be-6501e3f67291 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:24:19.300375 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-7ef783ab-788b-40e9-a302-6537079bd089 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:19.301299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-7ef783ab-788b-40e9-a302-6537079bd089 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:19.303350 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:19.308319 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7ef783ab-788b-40e9-a302-6537079bd089 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:19.312115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7ef783ab-788b-40e9-a302-6537079bd089 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:19.312115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7ef783ab-788b-40e9-a302-6537079bd089 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:19.312115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7ef783ab-788b-40e9-a302-6537079bd089 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:19.341257 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-7ef783ab-788b-40e9-a302-6537079bd089 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045572 Jul 14 12:24:19.341909 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 422/834] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:19 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:19.482267 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5956b9ad-cef5-49be-a9fe-5becac623d4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:19.482998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5956b9ad-cef5-49be-a9fe-5becac623d4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:19.489804 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5956b9ad-cef5-49be-a9fe-5becac623d4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:19.490291 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5956b9ad-cef5-49be-a9fe-5becac623d4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:19.491088 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5956b9ad-cef5-49be-a9fe-5becac623d4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:19.491527 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5956b9ad-cef5-49be-a9fe-5becac623d4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:19.516324 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3337498b-798c-410c-817b-19e1596072a9 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:19.517840 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3337498b-798c-410c-817b-19e1596072a9 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:19.524544 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3337498b-798c-410c-817b-19e1596072a9 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:19.525001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3337498b-798c-410c-817b-19e1596072a9 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:19.525779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3337498b-798c-410c-817b-19e1596072a9 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:19.526220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3337498b-798c-410c-817b-19e1596072a9 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:19.556951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3337498b-798c-410c-817b-19e1596072a9 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Jul 14 12:24:19.557443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 423/835] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:19 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:24:19.625177 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5956b9ad-cef5-49be-a9fe-5becac623d4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:19.632930 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5956b9ad-cef5-49be-a9fe-5becac623d4b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1571 microversion: 2.1 time: 0.154934 Jul 14 12:24:19.633485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 413/836] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:19 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1571 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:19.704608 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-40f9a7ef-08a0-4b37-bc21-997d38aee5f2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:19.705790 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-40f9a7ef-08a0-4b37-bc21-997d38aee5f2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:19.711890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40f9a7ef-08a0-4b37-bc21-997d38aee5f2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:19.712337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40f9a7ef-08a0-4b37-bc21-997d38aee5f2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:19.713098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40f9a7ef-08a0-4b37-bc21-997d38aee5f2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:19.713532 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40f9a7ef-08a0-4b37-bc21-997d38aee5f2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:19.852764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-40f9a7ef-08a0-4b37-bc21-997d38aee5f2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:19.864086 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-40f9a7ef-08a0-4b37-bc21-997d38aee5f2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:19.866251 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-40f9a7ef-08a0-4b37-bc21-997d38aee5f2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:19.867677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-40f9a7ef-08a0-4b37-bc21-997d38aee5f2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.166824 Jul 14 12:24:19.868442 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 424/837] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:19 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:20.069529 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-e31089d4-5d4c-48ff-a029-ccdd3520bcb8 req-a24898ea-a626-4b28-aa7e-1e0cfb476ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a356720e-5371-4d02-bd6d-5293e39ed68a", "name": "network-vif-plugged", "status": "completed", "tag": "3c14bf32-ee21-46df-a087-dc33eef08a69"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:20.081435 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-e31089d4-5d4c-48ff-a029-ccdd3520bcb8 req-a24898ea-a626-4b28-aa7e-1e0cfb476ae8 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:20.087214 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-e31089d4-5d4c-48ff-a029-ccdd3520bcb8 req-a24898ea-a626-4b28-aa7e-1e0cfb476ae8 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:20.101256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-e31089d4-5d4c-48ff-a029-ccdd3520bcb8 req-a24898ea-a626-4b28-aa7e-1e0cfb476ae8 service nova] Creating event network-vif-plugged:3c14bf32-ee21-46df-a087-dc33eef08a69 for instance a356720e-5371-4d02-bd6d-5293e39ed68a on hv-cinder-84890 Jul 14 12:24:20.107786 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-e31089d4-5d4c-48ff-a029-ccdd3520bcb8 req-a24898ea-a626-4b28-aa7e-1e0cfb476ae8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042299 Jul 14 12:24:20.109095 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 414/838] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:20.354615 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-849f5ade-ee37-4acb-9630-5b0b88049e89 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:20.355520 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-849f5ade-ee37-4acb-9630-5b0b88049e89 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:20.363698 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-849f5ade-ee37-4acb-9630-5b0b88049e89 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:20.364155 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-849f5ade-ee37-4acb-9630-5b0b88049e89 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:20.364976 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-849f5ade-ee37-4acb-9630-5b0b88049e89 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:20.365417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-849f5ade-ee37-4acb-9630-5b0b88049e89 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:20.397905 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-849f5ade-ee37-4acb-9630-5b0b88049e89 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048070 Jul 14 12:24:20.398480 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 425/839] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:20 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:20.574808 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-efe5a86e-09eb-4c13-b6ca-0b6ba381fc7b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:20.575853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-efe5a86e-09eb-4c13-b6ca-0b6ba381fc7b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:20.582160 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efe5a86e-09eb-4c13-b6ca-0b6ba381fc7b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:20.582609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efe5a86e-09eb-4c13-b6ca-0b6ba381fc7b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:20.583419 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efe5a86e-09eb-4c13-b6ca-0b6ba381fc7b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:20.583861 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efe5a86e-09eb-4c13-b6ca-0b6ba381fc7b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:20.613770 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-efe5a86e-09eb-4c13-b6ca-0b6ba381fc7b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043802 Jul 14 12:24:20.614247 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 415/840] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:20 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:20.650205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8d2273cc-65d2-4636-9065-a7bf1348508b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:20.650859 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8d2273cc-65d2-4636-9065-a7bf1348508b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:20.658308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8d2273cc-65d2-4636-9065-a7bf1348508b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:20.658798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8d2273cc-65d2-4636-9065-a7bf1348508b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:20.659584 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8d2273cc-65d2-4636-9065-a7bf1348508b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:20.660011 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8d2273cc-65d2-4636-9065-a7bf1348508b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:20.799645 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8d2273cc-65d2-4636-9065-a7bf1348508b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:20.807370 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8d2273cc-65d2-4636-9065-a7bf1348508b tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1558 microversion: 2.1 time: 0.160944 Jul 14 12:24:20.807928 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 426/841] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:20 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:20.886702 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3eecbbd8-ef9b-451e-a82f-dcf7738209c7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:20.887258 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3eecbbd8-ef9b-451e-a82f-dcf7738209c7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:20.893756 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3eecbbd8-ef9b-451e-a82f-dcf7738209c7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:20.894193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3eecbbd8-ef9b-451e-a82f-dcf7738209c7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:20.894973 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3eecbbd8-ef9b-451e-a82f-dcf7738209c7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:20.895401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3eecbbd8-ef9b-451e-a82f-dcf7738209c7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:21.028012 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3eecbbd8-ef9b-451e-a82f-dcf7738209c7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:21.036476 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3eecbbd8-ef9b-451e-a82f-dcf7738209c7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:21.037960 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3eecbbd8-ef9b-451e-a82f-dcf7738209c7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:21.039089 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3eecbbd8-ef9b-451e-a82f-dcf7738209c7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.156353 Jul 14 12:24:21.039649 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 416/842] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:20 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:21.409965 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-31950563-26a3-41b1-a809-fc8b82c22156 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:21.411003 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-31950563-26a3-41b1-a809-fc8b82c22156 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:21.416974 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-31950563-26a3-41b1-a809-fc8b82c22156 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:21.417420 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-31950563-26a3-41b1-a809-fc8b82c22156 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:21.418176 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-31950563-26a3-41b1-a809-fc8b82c22156 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:21.418609 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-31950563-26a3-41b1-a809-fc8b82c22156 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:21.448122 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-31950563-26a3-41b1-a809-fc8b82c22156 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042571 Jul 14 12:24:21.448684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 427/843] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:21 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:21.625814 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ba56999e-b20e-4750-a3c2-243d2724cac5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:21.626995 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ba56999e-b20e-4750-a3c2-243d2724cac5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:21.633599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ba56999e-b20e-4750-a3c2-243d2724cac5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:21.634046 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ba56999e-b20e-4750-a3c2-243d2724cac5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:21.634842 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ba56999e-b20e-4750-a3c2-243d2724cac5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:21.635281 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ba56999e-b20e-4750-a3c2-243d2724cac5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:21.666210 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ba56999e-b20e-4750-a3c2-243d2724cac5 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044356 Jul 14 12:24:21.666937 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 417/844] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:21 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 12:24:21.676813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a42eea52-4375-4730-819a-005cbb11fdec tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:21.677306 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a42eea52-4375-4730-819a-005cbb11fdec tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:21.683906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a42eea52-4375-4730-819a-005cbb11fdec tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:21.684358 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a42eea52-4375-4730-819a-005cbb11fdec tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:21.685121 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a42eea52-4375-4730-819a-005cbb11fdec tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:21.685557 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a42eea52-4375-4730-819a-005cbb11fdec tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:21.762360 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-a42eea52-4375-4730-819a-005cbb11fdec tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] HTTP exception thrown: Instance 357e6fda-615e-4e1a-9f33-552398705e3e is not attached to volume dc365573-26bb-4d0e-a240-59272046a3d1 Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a42eea52-4375-4730-819a-005cbb11fdec tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Request method failure captured: Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: DELETE /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments/dc365573-26bb-4d0e-a240-59272046a3d1 HTTP/1.1 Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AokITxDasmR96xdrult83lPmZHJ6cNeT3JcgHPT4enKOKbQG2vme01w9ECC4XMT0ArJGT_hkheNne9c-BWZY--vLqXDerWLhx6KSx2oMtsVVD8_s8PltT-Mn6av_S32-VdphjZR7AdV390YS3gIxUiJNzkO6szIJgCk9gZ75Q6G71I Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: a37bbdf2bd2f4392ab2ddb60d6b6ad7c Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-TestMinimumBasicScenario-701615793 Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:24:21.773193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a37bbdf2bd2f4392ab2ddb60d6b6ad7c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a37bbdf2bd2f4392ab2ddb60d6b6ad7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a37bbdf2bd2f4392ab2ddb60d6b6ad7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a37bbdf2bd2f4392ab2ddb60d6b6ad7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-TestMinimumBasicScenario-701615793 Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: a37bbdf2bd2f4392ab2ddb60d6b6ad7c Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-TestMinimumBasicScenario-701615793 Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-TestMinimumBasicScenario-701615793-project Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: c72a81dcca3145fe9f9623e49baba829 Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-TestMinimumBasicScenario-701615793-project Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:24:21.774855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance 357e6fda-615e-4e1a-9f33-552398705e3e is not attached to volume dc365573-26bb-4d0e-a240-59272046a3d1 Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'server_id': '357e6fda-615e-4e1a-9f33-552398705e3e', 'id': 'dc365573-26bb-4d0e-a240-59272046a3d1'} Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id dc365573-26bb-4d0e-a240-59272046a3d1. Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:24:21.775688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357e6fda-615e-4e1a-9f33-552398705e3e is not attached to volume dc365573-26bb-4d0e-a240-59272046a3d1 Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357e6fda-615e-4e1a-9f33-552398705e3e is not attached to volume dc365573-26bb-4d0e-a240-59272046a3d1 Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:21.777052 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a42eea52-4375-4730-819a-005cbb11fdec tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Returning 404 to user: Instance 357e6fda-615e-4e1a-9f33-552398705e3e is not attached to volume dc365573-26bb-4d0e-a240-59272046a3d1 {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:24:21.778120 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a42eea52-4375-4730-819a-005cbb11fdec tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "DELETE /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments/dc365573-26bb-4d0e-a240-59272046a3d1" status: 404 len: 154 microversion: 2.1 time: 0.101803 Jul 14 12:24:21.778120 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 428/845] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:24:21 2022] DELETE /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e/os-volume_attachments/dc365573-26bb-4d0e-a240-59272046a3d1 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:24:22.059322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-63dcac25-d692-47d9-a88a-c03f7913b72f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:22.059971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-63dcac25-d692-47d9-a88a-c03f7913b72f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:22.067363 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-63dcac25-d692-47d9-a88a-c03f7913b72f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:22.068073 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-63dcac25-d692-47d9-a88a-c03f7913b72f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:22.069157 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-63dcac25-d692-47d9-a88a-c03f7913b72f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:22.069834 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-63dcac25-d692-47d9-a88a-c03f7913b72f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:22.208135 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-63dcac25-d692-47d9-a88a-c03f7913b72f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:22.218006 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-63dcac25-d692-47d9-a88a-c03f7913b72f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:22.220269 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-63dcac25-d692-47d9-a88a-c03f7913b72f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:22.221780 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-63dcac25-d692-47d9-a88a-c03f7913b72f tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1406 microversion: 2.20 time: 0.168017 Jul 14 12:24:22.222535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 418/846] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:22 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:24:22.459095 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4967460c-cb90-4e24-8a93-2679ba57ce78 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:22.460109 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4967460c-cb90-4e24-8a93-2679ba57ce78 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:22.466215 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4967460c-cb90-4e24-8a93-2679ba57ce78 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:22.466684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4967460c-cb90-4e24-8a93-2679ba57ce78 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:22.467476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4967460c-cb90-4e24-8a93-2679ba57ce78 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:22.467912 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4967460c-cb90-4e24-8a93-2679ba57ce78 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:22.486250 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:22.499059 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4967460c-cb90-4e24-8a93-2679ba57ce78 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Jul 14 12:24:22.499612 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 429/847] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:22 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:23.027192 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-97a0ce32-a138-40c4-b419-caba7ee47896 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:23.027866 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-97a0ce32-a138-40c4-b419-caba7ee47896 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:23.034897 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-97a0ce32-a138-40c4-b419-caba7ee47896 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.035351 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-97a0ce32-a138-40c4-b419-caba7ee47896 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.036313 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-97a0ce32-a138-40c4-b419-caba7ee47896 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.036754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-97a0ce32-a138-40c4-b419-caba7ee47896 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.066311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-97a0ce32-a138-40c4-b419-caba7ee47896 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Going to try to terminate instance {{(pid=118263) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:24:23.092875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:23.157077 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-eb4605ac-42d0-43d2-9a01-29d9c982b958 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:23.157582 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-eb4605ac-42d0-43d2-9a01-29d9c982b958 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:23.165398 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eb4605ac-42d0-43d2-9a01-29d9c982b958 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.165843 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eb4605ac-42d0-43d2-9a01-29d9c982b958 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.166639 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eb4605ac-42d0-43d2-9a01-29d9c982b958 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.167125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eb4605ac-42d0-43d2-9a01-29d9c982b958 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.199698 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-eb4605ac-42d0-43d2-9a01-29d9c982b958 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/ips" status: 200 len: 146 microversion: 2.1 time: 0.046581 Jul 14 12:24:23.200369 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 430/848] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:24:23 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:24:23.240381 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0a8ccbd3-734d-41a5-8404-c96646a0276a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:23.241069 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0a8ccbd3-734d-41a5-8404-c96646a0276a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:23.247936 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a8ccbd3-734d-41a5-8404-c96646a0276a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.248440 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a8ccbd3-734d-41a5-8404-c96646a0276a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.249152 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a8ccbd3-734d-41a5-8404-c96646a0276a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.249729 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a8ccbd3-734d-41a5-8404-c96646a0276a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.358412 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-97a0ce32-a138-40c4-b419-caba7ee47896 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "DELETE /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 204 len: 0 microversion: 2.1 time: 0.334983 Jul 14 12:24:23.359155 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 419/849] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:24:23 2022] DELETE /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:24:23.367913 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-afb81ec6-cae7-45fd-bfe3-f8ddfcca8754 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:23.368996 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-afb81ec6-cae7-45fd-bfe3-f8ddfcca8754 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:23.375895 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-afb81ec6-cae7-45fd-bfe3-f8ddfcca8754 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.376350 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-afb81ec6-cae7-45fd-bfe3-f8ddfcca8754 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.377223 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-afb81ec6-cae7-45fd-bfe3-f8ddfcca8754 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.377673 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-afb81ec6-cae7-45fd-bfe3-f8ddfcca8754 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.405093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0a8ccbd3-734d-41a5-8404-c96646a0276a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:23.414556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0a8ccbd3-734d-41a5-8404-c96646a0276a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:23.416306 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0a8ccbd3-734d-41a5-8404-c96646a0276a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:23.417474 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0a8ccbd3-734d-41a5-8404-c96646a0276a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1597 microversion: 2.20 time: 0.181279 Jul 14 12:24:23.418315 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 431/850] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:24:23 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1597 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:24:23.441653 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-116d7fba-5e7b-4bc2-bf03-5aa3a8084115 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:23.442173 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-116d7fba-5e7b-4bc2-bf03-5aa3a8084115 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:23.448239 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-116d7fba-5e7b-4bc2-bf03-5aa3a8084115 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.448697 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-116d7fba-5e7b-4bc2-bf03-5aa3a8084115 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.449474 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-116d7fba-5e7b-4bc2-bf03-5aa3a8084115 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.449918 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-116d7fba-5e7b-4bc2-bf03-5aa3a8084115 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.534015 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-116d7fba-5e7b-4bc2-bf03-5aa3a8084115 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.096837 Jul 14 12:24:23.535362 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 432/851] 10.222.0.27 () {60 vars in 1315 bytes} [Thu Jul 14 12:24:23 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 12:24:23.540164 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cb4d0fe1-6ce4-430c-8f4c-a3db6da3b40d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:23.544213 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-cb4d0fe1-6ce4-430c-8f4c-a3db6da3b40d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:23.548869 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb4d0fe1-6ce4-430c-8f4c-a3db6da3b40d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.549681 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb4d0fe1-6ce4-430c-8f4c-a3db6da3b40d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.551320 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb4d0fe1-6ce4-430c-8f4c-a3db6da3b40d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:23.551913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb4d0fe1-6ce4-430c-8f4c-a3db6da3b40d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:23.555520 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-afb81ec6-cae7-45fd-bfe3-f8ddfcca8754 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:23.564550 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-afb81ec6-cae7-45fd-bfe3-f8ddfcca8754 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1553 microversion: 2.1 time: 0.200499 Jul 14 12:24:23.576152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 420/852] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:23 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:24:23.595896 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cb4d0fe1-6ce4-430c-8f4c-a3db6da3b40d tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059078 Jul 14 12:24:23.596485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 433/853] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:23 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:24.584265 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8e392bdd-7ac8-4345-9ff7-b2b556a0681e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:24.584837 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8e392bdd-7ac8-4345-9ff7-b2b556a0681e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:24.592027 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8e392bdd-7ac8-4345-9ff7-b2b556a0681e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:24.592639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8e392bdd-7ac8-4345-9ff7-b2b556a0681e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:24.593279 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8e392bdd-7ac8-4345-9ff7-b2b556a0681e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:24.593717 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8e392bdd-7ac8-4345-9ff7-b2b556a0681e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:24.614222 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5f6ecc26-f04f-4006-a2ee-b96c244f7fd1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:24.621014 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5f6ecc26-f04f-4006-a2ee-b96c244f7fd1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:24.630677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5f6ecc26-f04f-4006-a2ee-b96c244f7fd1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:24.632246 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5f6ecc26-f04f-4006-a2ee-b96c244f7fd1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:24.633570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5f6ecc26-f04f-4006-a2ee-b96c244f7fd1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:24.634256 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5f6ecc26-f04f-4006-a2ee-b96c244f7fd1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:24.669110 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5f6ecc26-f04f-4006-a2ee-b96c244f7fd1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064769 Jul 14 12:24:24.670040 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 434/854] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:24 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:24.678715 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-f28220c6-6eaa-41dd-93e6-fb18979c7d33 req-d999bc8e-ab6a-4c01-ab26-18e939406215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a356720e-5371-4d02-bd6d-5293e39ed68a", "tag": "3c14bf32-ee21-46df-a087-dc33eef08a69"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:24.687284 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-f28220c6-6eaa-41dd-93e6-fb18979c7d33 req-d999bc8e-ab6a-4c01-ab26-18e939406215 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:24.688049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-f28220c6-6eaa-41dd-93e6-fb18979c7d33 req-d999bc8e-ab6a-4c01-ab26-18e939406215 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:24.700958 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-f28220c6-6eaa-41dd-93e6-fb18979c7d33 req-d999bc8e-ab6a-4c01-ab26-18e939406215 service nova] Creating event network-changed:3c14bf32-ee21-46df-a087-dc33eef08a69 for instance a356720e-5371-4d02-bd6d-5293e39ed68a on hv-cinder-84890 Jul 14 12:24:24.706891 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-f28220c6-6eaa-41dd-93e6-fb18979c7d33 req-d999bc8e-ab6a-4c01-ab26-18e939406215 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031630 Jul 14 12:24:24.707619 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 435/855] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:24.804619 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8e392bdd-7ac8-4345-9ff7-b2b556a0681e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:24.812569 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8e392bdd-7ac8-4345-9ff7-b2b556a0681e tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1553 microversion: 2.1 time: 0.232999 Jul 14 12:24:24.813213 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 421/856] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:24 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1553 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:24.946443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6394a6eb-05fe-4ca2-92a6-3ca59d96f36c tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db5f6c71-c852-45aa-b632-b1e47b09e7a3"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:24.947751 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6394a6eb-05fe-4ca2-92a6-3ca59d96f36c tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:24.954511 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6394a6eb-05fe-4ca2-92a6-3ca59d96f36c tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:24.955025 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6394a6eb-05fe-4ca2-92a6-3ca59d96f36c tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:24.955863 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6394a6eb-05fe-4ca2-92a6-3ca59d96f36c tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:24.957090 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6394a6eb-05fe-4ca2-92a6-3ca59d96f36c tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:25.685897 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cd57ce7e-f2d4-4857-a15f-f259b2a56394 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:25.689290 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-cd57ce7e-f2d4-4857-a15f-f259b2a56394 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:25.699607 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cd57ce7e-f2d4-4857-a15f-f259b2a56394 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:25.700152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cd57ce7e-f2d4-4857-a15f-f259b2a56394 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:25.701560 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cd57ce7e-f2d4-4857-a15f-f259b2a56394 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:25.702246 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cd57ce7e-f2d4-4857-a15f-f259b2a56394 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:25.747828 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-cd57ce7e-f2d4-4857-a15f-f259b2a56394 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068627 Jul 14 12:24:25.748431 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 422/857] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:25 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 12:24:25.837705 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7c64d9a8-8974-435a-8299-5e3272cb60b3 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:25.838825 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7c64d9a8-8974-435a-8299-5e3272cb60b3 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:25.847385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7c64d9a8-8974-435a-8299-5e3272cb60b3 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:25.848473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7c64d9a8-8974-435a-8299-5e3272cb60b3 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:25.849458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7c64d9a8-8974-435a-8299-5e3272cb60b3 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:25.850402 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7c64d9a8-8974-435a-8299-5e3272cb60b3 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:26.379433 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6394a6eb-05fe-4ca2-92a6-3ca59d96f36c tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.437373 Jul 14 12:24:26.380040 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 436/858] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:24:24 2022] POST /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments => generated 194 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:26.393014 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-32a61181-8d62-4118-ae12-bcd9ef032943 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:26.394234 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-32a61181-8d62-4118-ae12-bcd9ef032943 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:26.407791 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-32a61181-8d62-4118-ae12-bcd9ef032943 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:26.408408 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-32a61181-8d62-4118-ae12-bcd9ef032943 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:26.410536 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-32a61181-8d62-4118-ae12-bcd9ef032943 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:26.411179 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-32a61181-8d62-4118-ae12-bcd9ef032943 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:26.438223 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-32a61181-8d62-4118-ae12-bcd9ef032943 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:24:26.527255 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7c64d9a8-8974-435a-8299-5e3272cb60b3 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:26.538371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7c64d9a8-8974-435a-8299-5e3272cb60b3 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1553 microversion: 2.1 time: 0.712427 Jul 14 12:24:26.548884 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 423/859] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:25 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1553 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:26.725827 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-32a61181-8d62-4118-ae12-bcd9ef032943 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 204 len: 0 microversion: 2.1 time: 0.344174 Jul 14 12:24:26.726831 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 437/860] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:24:26 2022] DELETE /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:24:26.734936 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-465c5dd8-1f2b-480c-9e81-e2b7e852cd98 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:26.735565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-465c5dd8-1f2b-480c-9e81-e2b7e852cd98 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:26.743510 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-465c5dd8-1f2b-480c-9e81-e2b7e852cd98 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:26.744378 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-465c5dd8-1f2b-480c-9e81-e2b7e852cd98 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:26.745180 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-465c5dd8-1f2b-480c-9e81-e2b7e852cd98 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:26.745627 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-465c5dd8-1f2b-480c-9e81-e2b7e852cd98 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:27.141821 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-465c5dd8-1f2b-480c-9e81-e2b7e852cd98 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:27.151068 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-465c5dd8-1f2b-480c-9e81-e2b7e852cd98 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1689 microversion: 2.1 time: 0.419978 Jul 14 12:24:27.161724 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 424/861] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:26 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1689 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:27.540131 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-f0d4b524-d45f-4e07-ab13-9cbf2d073a58 req-d9632a44-0e1d-48b5-8bf9-8685b49dc74c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "357e6fda-615e-4e1a-9f33-552398705e3e", "name": "network-vif-deleted", "tag": "8d1d4c31-5832-429c-8506-0433ac2a974b"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:27.558220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-f0d4b524-d45f-4e07-ab13-9cbf2d073a58 req-d9632a44-0e1d-48b5-8bf9-8685b49dc74c service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:27.558918 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-53f07f23-71d4-464f-af38-403072c6bbbe tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:27.559389 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-f0d4b524-d45f-4e07-ab13-9cbf2d073a58 req-d9632a44-0e1d-48b5-8bf9-8685b49dc74c service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:27.559707 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-53f07f23-71d4-464f-af38-403072c6bbbe tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:27.570593 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-53f07f23-71d4-464f-af38-403072c6bbbe tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:27.571083 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-53f07f23-71d4-464f-af38-403072c6bbbe tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:27.572319 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-53f07f23-71d4-464f-af38-403072c6bbbe tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:27.572763 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-53f07f23-71d4-464f-af38-403072c6bbbe tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:27.574252 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-f0d4b524-d45f-4e07-ab13-9cbf2d073a58 req-d9632a44-0e1d-48b5-8bf9-8685b49dc74c service nova] Creating event network-vif-deleted:8d1d4c31-5832-429c-8506-0433ac2a974b for instance 357e6fda-615e-4e1a-9f33-552398705e3e on hv-cinder-84890 Jul 14 12:24:27.579452 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-f0d4b524-d45f-4e07-ab13-9cbf2d073a58 req-d9632a44-0e1d-48b5-8bf9-8685b49dc74c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044214 Jul 14 12:24:27.580162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 438/862] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:24:27.652647 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-53f07f23-71d4-464f-af38-403072c6bbbe tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:27.661083 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-53f07f23-71d4-464f-af38-403072c6bbbe tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1511 microversion: 2.1 time: 0.107911 Jul 14 12:24:27.661667 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 425/863] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:27 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1511 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:28.171679 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0a873d7c-8db4-4ebe-8b40-7f31bdceacb3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:28.172854 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0a873d7c-8db4-4ebe-8b40-7f31bdceacb3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:28.181029 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a873d7c-8db4-4ebe-8b40-7f31bdceacb3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:28.181500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a873d7c-8db4-4ebe-8b40-7f31bdceacb3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:28.182289 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a873d7c-8db4-4ebe-8b40-7f31bdceacb3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:28.183172 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0a873d7c-8db4-4ebe-8b40-7f31bdceacb3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:28.318344 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0a873d7c-8db4-4ebe-8b40-7f31bdceacb3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:28.326175 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0a873d7c-8db4-4ebe-8b40-7f31bdceacb3 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1689 microversion: 2.1 time: 0.160729 Jul 14 12:24:28.326755 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 439/864] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:28 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:28.678327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8a44c423-f595-45b5-9654-a8e43d3b3300 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:28.678989 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8a44c423-f595-45b5-9654-a8e43d3b3300 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:28.685867 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a44c423-f595-45b5-9654-a8e43d3b3300 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:28.686314 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a44c423-f595-45b5-9654-a8e43d3b3300 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:28.687330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a44c423-f595-45b5-9654-a8e43d3b3300 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:28.687830 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8a44c423-f595-45b5-9654-a8e43d3b3300 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:28.762425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8a44c423-f595-45b5-9654-a8e43d3b3300 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:28.770198 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8a44c423-f595-45b5-9654-a8e43d3b3300 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1511 microversion: 2.1 time: 0.096292 Jul 14 12:24:28.771097 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 426/865] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:28 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:29.344371 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2b6a01a0-7eba-4f56-b51e-dbfc32ea6dc1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:29.345338 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2b6a01a0-7eba-4f56-b51e-dbfc32ea6dc1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:29.359098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b6a01a0-7eba-4f56-b51e-dbfc32ea6dc1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:29.359558 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b6a01a0-7eba-4f56-b51e-dbfc32ea6dc1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:29.360342 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b6a01a0-7eba-4f56-b51e-dbfc32ea6dc1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:29.360779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2b6a01a0-7eba-4f56-b51e-dbfc32ea6dc1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:29.552544 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2b6a01a0-7eba-4f56-b51e-dbfc32ea6dc1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:29.563321 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2b6a01a0-7eba-4f56-b51e-dbfc32ea6dc1 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1689 microversion: 2.1 time: 0.222680 Jul 14 12:24:29.568439 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 440/866] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:29 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1689 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:29.788228 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-304f3466-9103-4f43-977d-8c9c56b5300b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:29.788863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-304f3466-9103-4f43-977d-8c9c56b5300b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:29.795959 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-304f3466-9103-4f43-977d-8c9c56b5300b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:29.796649 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-304f3466-9103-4f43-977d-8c9c56b5300b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:29.797578 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-304f3466-9103-4f43-977d-8c9c56b5300b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:29.798488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-304f3466-9103-4f43-977d-8c9c56b5300b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:29.864485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-304f3466-9103-4f43-977d-8c9c56b5300b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:29.872232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-304f3466-9103-4f43-977d-8c9c56b5300b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1511 microversion: 2.1 time: 0.088452 Jul 14 12:24:29.873117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 427/867] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:29 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1511 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:30.580847 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8350dbf1-9249-452e-b2ff-7cbdfe093c2b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:30.584705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8350dbf1-9249-452e-b2ff-7cbdfe093c2b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:30.590609 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8350dbf1-9249-452e-b2ff-7cbdfe093c2b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:30.591293 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8350dbf1-9249-452e-b2ff-7cbdfe093c2b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:30.592630 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8350dbf1-9249-452e-b2ff-7cbdfe093c2b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:30.593353 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8350dbf1-9249-452e-b2ff-7cbdfe093c2b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:30.779666 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8350dbf1-9249-452e-b2ff-7cbdfe093c2b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:30.787961 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8350dbf1-9249-452e-b2ff-7cbdfe093c2b tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1689 microversion: 2.1 time: 0.211523 Jul 14 12:24:30.788558 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 441/868] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:30 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1689 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:30.996859 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:30.996859 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:30.996859 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:30.996859 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:30.997938 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:30.997938 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:30.997938 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:30.997938 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:30.998249 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lazy-loading 'fault' on Instance uuid 357e6fda-615e-4e1a-9f33-552398705e3e {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:24:31.098257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:31.106182 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-dbdc4faa-d941-4cce-bf2d-38ccb692a3ee tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1348 microversion: 2.1 time: 0.220553 Jul 14 12:24:31.106784 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 428/869] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:30 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1348 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:31.805811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b4c0c6c3-49f4-4a6c-8ccc-09d6a89afd08 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:31.806525 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b4c0c6c3-49f4-4a6c-8ccc-09d6a89afd08 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:31.812970 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b4c0c6c3-49f4-4a6c-8ccc-09d6a89afd08 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:31.815432 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b4c0c6c3-49f4-4a6c-8ccc-09d6a89afd08 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:31.815432 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b4c0c6c3-49f4-4a6c-8ccc-09d6a89afd08 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:31.815432 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b4c0c6c3-49f4-4a6c-8ccc-09d6a89afd08 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:31.996142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b4c0c6c3-49f4-4a6c-8ccc-09d6a89afd08 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:32.007156 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b4c0c6c3-49f4-4a6c-8ccc-09d6a89afd08 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1689 microversion: 2.1 time: 0.205125 Jul 14 12:24:32.017400 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 442/870] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:31 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1689 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:32.124384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:32.125025 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:32.131970 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:32.132412 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:32.133186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:32.133675 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:32.172769 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:32.173285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:32.173745 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lazy-loading 'fault' on Instance uuid 357e6fda-615e-4e1a-9f33-552398705e3e {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:24:32.239281 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c72a81dcca3145fe9f9623e49baba829', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a37bbdf2bd2f4392ab2ddb60d6b6ad7c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:32.251153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a95644a3-d855-4a50-90b8-e1d9b26f2136 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 200 len: 1348 microversion: 2.1 time: 0.130565 Jul 14 12:24:32.252289 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 429/871] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:32 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 1348 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:32.397832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-3055c077-c433-406a-9294-b1aa3d0dbfd3 req-260dd224-b0d8-4f02-8243-ec72d36e8668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "158005c6-a074-4abf-a8b8-7c1ee3250b2e", "name": "network-vif-deleted", "tag": "ea14a717-a283-4fb9-92a3-043257ce7e6e"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:32.417496 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-3055c077-c433-406a-9294-b1aa3d0dbfd3 req-260dd224-b0d8-4f02-8243-ec72d36e8668 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:32.418036 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-3055c077-c433-406a-9294-b1aa3d0dbfd3 req-260dd224-b0d8-4f02-8243-ec72d36e8668 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:32.472324 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-3055c077-c433-406a-9294-b1aa3d0dbfd3 req-260dd224-b0d8-4f02-8243-ec72d36e8668 service nova] Creating event network-vif-deleted:ea14a717-a283-4fb9-92a3-043257ce7e6e for instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e on hv-cinder-84890 Jul 14 12:24:32.477649 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-3055c077-c433-406a-9294-b1aa3d0dbfd3 req-260dd224-b0d8-4f02-8243-ec72d36e8668 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084779 Jul 14 12:24:32.478952 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 443/872] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:32.976898 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a8bf204a-5cbf-4522-b7af-3b8e6e8b6dc2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:32.978347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a8bf204a-5cbf-4522-b7af-3b8e6e8b6dc2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:32.990955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8bf204a-5cbf-4522-b7af-3b8e6e8b6dc2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:32.991821 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8bf204a-5cbf-4522-b7af-3b8e6e8b6dc2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:32.995220 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8bf204a-5cbf-4522-b7af-3b8e6e8b6dc2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:32.995858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a8bf204a-5cbf-4522-b7af-3b8e6e8b6dc2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:33.026258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:33.027598 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:33.040526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:33.041253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:33.042258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:33.047560 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:33.066367 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a8bf204a-5cbf-4522-b7af-3b8e6e8b6dc2 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093238 Jul 14 12:24:33.066997 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 430/873] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:32 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:33.077202 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-707b83f6-5f71-4856-86ba-78929ebae5e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:33.085105 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-707b83f6-5f71-4856-86ba-78929ebae5e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:33.094516 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-707b83f6-5f71-4856-86ba-78929ebae5e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:33.095286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-707b83f6-5f71-4856-86ba-78929ebae5e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:33.096862 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-707b83f6-5f71-4856-86ba-78929ebae5e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:33.097507 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-707b83f6-5f71-4856-86ba-78929ebae5e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:33.121419 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:33.122940 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:33.123782 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lazy-loading 'fault' on Instance uuid 158005c6-a074-4abf-a8b8-7c1ee3250b2e {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:24:33.168287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-707b83f6-5f71-4856-86ba-78929ebae5e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments/db5f6c71-c852-45aa-b632-b1e47b09e7a3" status: 200 len: 194 microversion: 2.1 time: 0.094967 Jul 14 12:24:33.185878 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:33.189110 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 431/874] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Jul 14 12:24:33 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments/db5f6c71-c852-45aa-b632-b1e47b09e7a3 => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:33.202034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-878a2020-e4e4-45b4-b8f8-89fdb7ef9900 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 200 len: 1335 microversion: 2.1 time: 0.181283 Jul 14 12:24:33.203308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 444/875] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:33 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 1335 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:33.272042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d91b3d36-7e39-49f3-b144-18705fc07fe6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:33.273349 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d91b3d36-7e39-49f3-b144-18705fc07fe6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] [instance: 357e6fda-615e-4e1a-9f33-552398705e3e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:33.285916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d91b3d36-7e39-49f3-b144-18705fc07fe6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:33.289072 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d91b3d36-7e39-49f3-b144-18705fc07fe6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:33.291696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d91b3d36-7e39-49f3-b144-18705fc07fe6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:33.292951 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d91b3d36-7e39-49f3-b144-18705fc07fe6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:33.320636 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-d91b3d36-7e39-49f3-b144-18705fc07fe6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] HTTP exception thrown: Instance 357e6fda-615e-4e1a-9f33-552398705e3e could not be found. Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d91b3d36-7e39-49f3-b144-18705fc07fe6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Request method failure captured: Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e HTTP/1.1 Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AokITxDasmR96xdrult83lPmZHJ6cNeT3JcgHPT4enKOKbQG2vme01w9ECC4XMT0ArJGT_hkheNne9c-BWZY--vLqXDerWLhx6KSx2oMtsVVD8_s8PltT-Mn6av_S32-VdphjZR7AdV390YS3gIxUiJNzkO6szIJgCk9gZ75Q6G71I Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: a37bbdf2bd2f4392ab2ddb60d6b6ad7c Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-TestMinimumBasicScenario-701615793 Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:24:33.322694 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_a37bbdf2bd2f4392ab2ddb60d6b6ad7c", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/a37bbdf2bd2f4392ab2ddb60d6b6ad7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a37bbdf2bd2f4392ab2ddb60d6b6ad7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/a37bbdf2bd2f4392ab2ddb60d6b6ad7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-TestMinimumBasicScenario-701615793 Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: a37bbdf2bd2f4392ab2ddb60d6b6ad7c Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-TestMinimumBasicScenario-701615793 Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-TestMinimumBasicScenario-701615793-project Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: c72a81dcca3145fe9f9623e49baba829 Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-TestMinimumBasicScenario-701615793-project Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 357e6fda-615e-4e1a-9f33-552398705e3e could not be found. Jul 14 12:24:33.329751 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '357e6fda-615e-4e1a-9f33-552398705e3e'} Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 357e6fda-615e-4e1a-9f33-552398705e3e could not be found. Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:24:33.330911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 357e6fda-615e-4e1a-9f33-552398705e3e could not be found. Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 357e6fda-615e-4e1a-9f33-552398705e3e could not be found. Jul 14 12:24:33.332798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:33.334278 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d91b3d36-7e39-49f3-b144-18705fc07fe6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Returning 404 to user: Instance 357e6fda-615e-4e1a-9f33-552398705e3e could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:24:33.334278 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d91b3d36-7e39-49f3-b144-18705fc07fe6 tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e" status: 404 len: 111 microversion: 2.1 time: 0.056763 Jul 14 12:24:33.337580 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-75c01292-0cf2-4222-a808-511bfa41f50b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] Calling method '.version_select at 0x7f0e26745a60>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:33.340473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 432/876] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:33 2022] GET /compute/v2.1/servers/357e6fda-615e-4e1a-9f33-552398705e3e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:24:33.488887 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-75c01292-0cf2-4222-a808-511bfa41f50b tempest-TestMinimumBasicScenario-701615793 tempest-TestMinimumBasicScenario-701615793-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-497702175" status: 202 len: 0 microversion: 2.1 time: 0.155648 Jul 14 12:24:33.491958 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 445/877] 10.222.0.27 () {58 vars in 1268 bytes} [Thu Jul 14 12:24:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-497702175 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:24:34.221382 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b4ecf7e9-a301-4c51-89cb-dc276449a42e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:34.222055 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b4ecf7e9-a301-4c51-89cb-dc276449a42e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: 158005c6-a074-4abf-a8b8-7c1ee3250b2e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:34.239344 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b4ecf7e9-a301-4c51-89cb-dc276449a42e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:34.239804 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b4ecf7e9-a301-4c51-89cb-dc276449a42e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:34.240595 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b4ecf7e9-a301-4c51-89cb-dc276449a42e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:34.241067 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b4ecf7e9-a301-4c51-89cb-dc276449a42e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:34.258937 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-b4ecf7e9-a301-4c51-89cb-dc276449a42e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] HTTP exception thrown: Instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e could not be found. Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b4ecf7e9-a301-4c51-89cb-dc276449a42e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Request method failure captured: Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e HTTP/1.1 Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmW5SsGlFhf_TzJg-Og2kuIVv8Fr87QiUijllnSUBvnbHpUzpWuE-rphTVE092MKeLDRhLcGVdyeyzuLP58QmtlbDaIh0UNR1NEJmPgt08fjsBh5C6AY25wIZL2k57HAqwpUFzHaNbhMhB6AWiQ5Zhrh_g09fa_3mXp-B0btNHrPWQ Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: bb62d84584b3426687390833270648d6 Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:24:34.259875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb62d84584b3426687390833270648d6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb62d84584b3426687390833270648d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb62d84584b3426687390833270648d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb62d84584b3426687390833270648d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: bb62d84584b3426687390833270648d6 Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-ServerRescueNegativeTestJSON-1890584384-project Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 0d302e57946c42d799e9bf120873eba6 Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1890584384-project Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e could not be found. Jul 14 12:24:34.261556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '158005c6-a074-4abf-a8b8-7c1ee3250b2e'} Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e could not be found. Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:24:34.262416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e could not be found. Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e could not be found. Jul 14 12:24:34.264485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:34.268707 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b4ecf7e9-a301-4c51-89cb-dc276449a42e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Returning 404 to user: Instance 158005c6-a074-4abf-a8b8-7c1ee3250b2e could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:24:34.270321 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b4ecf7e9-a301-4c51-89cb-dc276449a42e tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e" status: 404 len: 111 microversion: 2.1 time: 0.052847 Jul 14 12:24:34.285303 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1f2025e4-048f-47ec-b0a7-acda503a4cc9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '.version_select at 0x7f0e263d2820>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:34.285773 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 433/878] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:34 2022] GET /compute/v2.1/servers/158005c6-a074-4abf-a8b8-7c1ee3250b2e => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:24:34.366537 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1f2025e4-048f-47ec-b0a7-acda503a4cc9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646546956" status: 202 len: 0 microversion: 2.1 time: 0.090164 Jul 14 12:24:34.379972 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 446/879] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jul 14 12:24:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1646546956 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 12:24:35.026907 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-04709e12-bfd0-4fb6-9929-394ab82a206d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f088b29c-08ab-4a9a-bec7-b5c71c19cbf3"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:35.028373 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-04709e12-bfd0-4fb6-9929-394ab82a206d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:35.037116 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-04709e12-bfd0-4fb6-9929-394ab82a206d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:35.037921 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-04709e12-bfd0-4fb6-9929-394ab82a206d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:35.038982 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-04709e12-bfd0-4fb6-9929-394ab82a206d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:35.039617 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-04709e12-bfd0-4fb6-9929-394ab82a206d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:35.893120 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:36.014098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-04709e12-bfd0-4fb6-9929-394ab82a206d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "POST /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991225 Jul 14 12:24:36.015453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 434/880] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:24:35 2022] POST /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:38.340682 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d425e8dc-1e82-4f82-b516-c4d8c525325f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:38.341244 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d425e8dc-1e82-4f82-b516-c4d8c525325f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:38.350343 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d425e8dc-1e82-4f82-b516-c4d8c525325f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:38.358064 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d425e8dc-1e82-4f82-b516-c4d8c525325f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:38.359243 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d425e8dc-1e82-4f82-b516-c4d8c525325f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:38.359895 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d425e8dc-1e82-4f82-b516-c4d8c525325f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:38.403192 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:38.417197 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d425e8dc-1e82-4f82-b516-c4d8c525325f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:24:38.844427 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d425e8dc-1e82-4f82-b516-c4d8c525325f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 204 len: 0 microversion: 2.1 time: 0.508037 Jul 14 12:24:38.845014 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 447/881] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:24:38 2022] DELETE /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:24:38.867314 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e142fe49-5c26-4802-82fb-70d7c68facea tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:38.868677 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e142fe49-5c26-4802-82fb-70d7c68facea tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:38.885372 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e142fe49-5c26-4802-82fb-70d7c68facea tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:38.889770 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e142fe49-5c26-4802-82fb-70d7c68facea tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:38.895167 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e142fe49-5c26-4802-82fb-70d7c68facea tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:38.897218 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e142fe49-5c26-4802-82fb-70d7c68facea tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:39.331185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e142fe49-5c26-4802-82fb-70d7c68facea tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:39.360456 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e142fe49-5c26-4802-82fb-70d7c68facea tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1508 microversion: 2.1 time: 0.507076 Jul 14 12:24:39.362343 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 435/882] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:38 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1508 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:40.379373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1deb5d48-c6fb-4f7c-bba9-e7b60f4d2b74 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:40.382407 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1deb5d48-c6fb-4f7c-bba9-e7b60f4d2b74 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:40.417130 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1deb5d48-c6fb-4f7c-bba9-e7b60f4d2b74 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:40.417130 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1deb5d48-c6fb-4f7c-bba9-e7b60f4d2b74 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:40.419716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1deb5d48-c6fb-4f7c-bba9-e7b60f4d2b74 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:40.419716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1deb5d48-c6fb-4f7c-bba9-e7b60f4d2b74 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:40.868244 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1deb5d48-c6fb-4f7c-bba9-e7b60f4d2b74 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:40.874344 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4915d720-55c5-4b25-b834-7f1acf15494b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Action: 'create', calling method: .version_select at 0x7f0e265b2160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-153859730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEcNYrWmPqfVaQsQST0dRhLKY1m0+qoNSfAJXFyM9y7neZtjTQjRuPCBbg6gXcBscxigrJIngTrkwR4ZO92n/LvSXetBVirZLmY20TgSi3U2dzMXCAJaOv6IhdCfasGfeg=="}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:40.888497 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1deb5d48-c6fb-4f7c-bba9-e7b60f4d2b74 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1508 microversion: 2.1 time: 0.513412 Jul 14 12:24:40.905139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 448/883] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:40 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1508 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:40.914898 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-4915d720-55c5-4b25-b834-7f1acf15494b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Getting quotas for project c0d098ca721b409385a08b91d861b295. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:24:40.923152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-4915d720-55c5-4b25-b834-7f1acf15494b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Getting quotas for user d0adaa092d944202b3279d10e0f94a91 and project c0d098ca721b409385a08b91d861b295. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:24:41.016573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4915d720-55c5-4b25-b834-7f1acf15494b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.430290 Jul 14 12:24:41.018317 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 436/884] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 12:24:40 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:41.331491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-4da53375-4c61-4b28-a04c-3cdc2556fd66 req-5bad84c2-8060-4093-b9ab-9a840b0e3db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a07e9511-3f33-44c5-8dfc-7ccdd3f12118", "name": "network-vif-deleted", "tag": "63aff066-06a0-4d2d-843c-dc7c5ba642ad"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:41.341580 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-4da53375-4c61-4b28-a04c-3cdc2556fd66 req-5bad84c2-8060-4093-b9ab-9a840b0e3db8 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:41.342177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-4da53375-4c61-4b28-a04c-3cdc2556fd66 req-5bad84c2-8060-4093-b9ab-9a840b0e3db8 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:41.363495 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-4da53375-4c61-4b28-a04c-3cdc2556fd66 req-5bad84c2-8060-4093-b9ab-9a840b0e3db8 service nova] Creating event network-vif-deleted:63aff066-06a0-4d2d-843c-dc7c5ba642ad for instance a07e9511-3f33-44c5-8dfc-7ccdd3f12118 on hv-cinder-84890 Jul 14 12:24:41.369325 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-4da53375-4c61-4b28-a04c-3cdc2556fd66 req-5bad84c2-8060-4093-b9ab-9a840b0e3db8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044332 Jul 14 12:24:41.370402 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 449/885] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:41.908095 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:41.909440 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:41.917172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:41.920979 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:41.920979 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:41.920979 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:41.957184 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:41.957879 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:41.958650 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lazy-loading 'fault' on Instance uuid a07e9511-3f33-44c5-8dfc-7ccdd3f12118 {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:24:42.011301 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:42.018879 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-098d44fa-448c-410f-a098-bb3496d305b7 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 200 len: 1311 microversion: 2.1 time: 0.115109 Jul 14 12:24:42.019466 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 437/886] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:41 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:43.039815 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c2cb4b6d-c616-4c33-9cec-07d0ae6dd2ad tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:43.041271 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c2cb4b6d-c616-4c33-9cec-07d0ae6dd2ad tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: a07e9511-3f33-44c5-8dfc-7ccdd3f12118] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:43.056794 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2cb4b6d-c616-4c33-9cec-07d0ae6dd2ad tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:43.058570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2cb4b6d-c616-4c33-9cec-07d0ae6dd2ad tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:43.060855 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2cb4b6d-c616-4c33-9cec-07d0ae6dd2ad tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:43.062913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c2cb4b6d-c616-4c33-9cec-07d0ae6dd2ad tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:43.084258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-c2cb4b6d-c616-4c33-9cec-07d0ae6dd2ad tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] HTTP exception thrown: Instance a07e9511-3f33-44c5-8dfc-7ccdd3f12118 could not be found. Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c2cb4b6d-c616-4c33-9cec-07d0ae6dd2ad tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Request method failure captured: Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 HTTP/1.1 Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AmW5SsGlFhf_TzJg-Og2kuIVv8Fr87QiUijllnSUBvnbHpUzpWuE-rphTVE092MKeLDRhLcGVdyeyzuLP58QmtlbDaIh0UNR1NEJmPgt08fjsBh5C6AY25wIZL2k57HAqwpUFzHaNbhMhB6AWiQ5Zhrh_g09fa_3mXp-B0btNHrPWQ Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: bb62d84584b3426687390833270648d6 Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:24:43.088228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb62d84584b3426687390833270648d6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb62d84584b3426687390833270648d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb62d84584b3426687390833270648d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb62d84584b3426687390833270648d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: bb62d84584b3426687390833270648d6 Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-ServerRescueNegativeTestJSON-1890584384-project Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 0d302e57946c42d799e9bf120873eba6 Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1890584384-project Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance a07e9511-3f33-44c5-8dfc-7ccdd3f12118 could not be found. Jul 14 12:24:43.089929 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'a07e9511-3f33-44c5-8dfc-7ccdd3f12118'} Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a07e9511-3f33-44c5-8dfc-7ccdd3f12118 could not be found. Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:24:43.090898 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a07e9511-3f33-44c5-8dfc-7ccdd3f12118 could not be found. Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a07e9511-3f33-44c5-8dfc-7ccdd3f12118 could not be found. Jul 14 12:24:43.092367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:43.094990 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c2cb4b6d-c616-4c33-9cec-07d0ae6dd2ad tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Returning 404 to user: Instance a07e9511-3f33-44c5-8dfc-7ccdd3f12118 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:24:43.097346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c2cb4b6d-c616-4c33-9cec-07d0ae6dd2ad tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118" status: 404 len: 111 microversion: 2.1 time: 0.063777 Jul 14 12:24:43.098489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 450/887] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:43 2022] GET /compute/v2.1/servers/a07e9511-3f33-44c5-8dfc-7ccdd3f12118 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:24:43.107954 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7ae18a85-7611-4240-a48d-f5bb9ee62b86 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:43.108854 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7ae18a85-7611-4240-a48d-f5bb9ee62b86 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:43.119247 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ae18a85-7611-4240-a48d-f5bb9ee62b86 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:43.119935 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ae18a85-7611-4240-a48d-f5bb9ee62b86 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:43.120876 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ae18a85-7611-4240-a48d-f5bb9ee62b86 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:43.121565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ae18a85-7611-4240-a48d-f5bb9ee62b86 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:43.172447 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7ae18a85-7611-4240-a48d-f5bb9ee62b86 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Going to try to terminate instance {{(pid=118263) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:24:43.619363 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7ae18a85-7611-4240-a48d-f5bb9ee62b86 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 204 len: 0 microversion: 2.1 time: 0.510495 Jul 14 12:24:43.620033 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 438/888] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:24:43 2022] DELETE /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:24:43.636175 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-70a6ee5b-5116-41fd-b389-40b153e33424 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:43.637378 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-70a6ee5b-5116-41fd-b389-40b153e33424 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:43.660463 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70a6ee5b-5116-41fd-b389-40b153e33424 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:43.661049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70a6ee5b-5116-41fd-b389-40b153e33424 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:43.662510 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70a6ee5b-5116-41fd-b389-40b153e33424 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:43.664806 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70a6ee5b-5116-41fd-b389-40b153e33424 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:43.898135 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-70a6ee5b-5116-41fd-b389-40b153e33424 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:43.907232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-70a6ee5b-5116-41fd-b389-40b153e33424 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.282309 Jul 14 12:24:43.907702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 451/889] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:43 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:44.927468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-6d4a2d22-bdca-4219-bca8-ddf7de4d019f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:44.930160 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-6d4a2d22-bdca-4219-bca8-ddf7de4d019f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:44.937850 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6d4a2d22-bdca-4219-bca8-ddf7de4d019f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:44.939394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6d4a2d22-bdca-4219-bca8-ddf7de4d019f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:44.941325 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6d4a2d22-bdca-4219-bca8-ddf7de4d019f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:44.941983 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6d4a2d22-bdca-4219-bca8-ddf7de4d019f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:45.097910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6d4a2d22-bdca-4219-bca8-ddf7de4d019f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:45.106653 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-6d4a2d22-bdca-4219-bca8-ddf7de4d019f tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.185277 Jul 14 12:24:45.107286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 439/890] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:44 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:46.124562 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b57bcb6e-6783-4ac9-9d81-c4228abafcf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:46.129857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b57bcb6e-6783-4ac9-9d81-c4228abafcf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:46.133207 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b57bcb6e-6783-4ac9-9d81-c4228abafcf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:46.133758 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b57bcb6e-6783-4ac9-9d81-c4228abafcf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:46.134527 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b57bcb6e-6783-4ac9-9d81-c4228abafcf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:46.135065 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b57bcb6e-6783-4ac9-9d81-c4228abafcf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:46.283891 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b57bcb6e-6783-4ac9-9d81-c4228abafcf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:46.292425 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b57bcb6e-6783-4ac9-9d81-c4228abafcf9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1522 microversion: 2.1 time: 0.171055 Jul 14 12:24:46.293319 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 452/891] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:46 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:46.926634 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-6e06511a-454c-4f26-a574-a795be890b75 req-7b97e2a5-1159-4a06-80d2-62c69a159306 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc2b616c-dc02-4d81-9eb1-028c8077a4fe", "name": "network-vif-deleted", "tag": "cd1e3c51-3b14-4f81-94e0-3273cc7ab2dd"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:46.930712 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:46.936026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-6e06511a-454c-4f26-a574-a795be890b75 req-7b97e2a5-1159-4a06-80d2-62c69a159306 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:46.936460 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-6e06511a-454c-4f26-a574-a795be890b75 req-7b97e2a5-1159-4a06-80d2-62c69a159306 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:46.949267 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-6e06511a-454c-4f26-a574-a795be890b75 req-7b97e2a5-1159-4a06-80d2-62c69a159306 service nova] Creating event network-vif-deleted:cd1e3c51-3b14-4f81-94e0-3273cc7ab2dd for instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe on hv-cinder-84890 Jul 14 12:24:46.954539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-6e06511a-454c-4f26-a574-a795be890b75 req-7b97e2a5-1159-4a06-80d2-62c69a159306 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 Jul 14 12:24:46.955719 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 440/892] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:47.133029 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a06b4511-0538-4d8d-9000-09c11618e097 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:47.134003 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a06b4511-0538-4d8d-9000-09c11618e097 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:47.140635 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a06b4511-0538-4d8d-9000-09c11618e097 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:47.141009 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a06b4511-0538-4d8d-9000-09c11618e097 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:47.141770 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a06b4511-0538-4d8d-9000-09c11618e097 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:47.143034 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a06b4511-0538-4d8d-9000-09c11618e097 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:47.178863 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a06b4511-0538-4d8d-9000-09c11618e097 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049698 Jul 14 12:24:47.179645 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 453/893] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:47 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:47.314339 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:47.315097 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:47.348349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c1f73d7d-c2af-494e-b25a-fc87ccf661d5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:47.348841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c1f73d7d-c2af-494e-b25a-fc87ccf661d5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:47.353060 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:47.353507 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:47.354293 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:47.354723 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:47.357281 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c1f73d7d-c2af-494e-b25a-fc87ccf661d5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:47.357729 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c1f73d7d-c2af-494e-b25a-fc87ccf661d5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:47.358498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c1f73d7d-c2af-494e-b25a-fc87ccf661d5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:47.358963 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c1f73d7d-c2af-494e-b25a-fc87ccf661d5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:47.390835 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c1f73d7d-c2af-494e-b25a-fc87ccf661d5 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments/db5f6c71-c852-45aa-b632-b1e47b09e7a3" status: 200 len: 194 microversion: 2.1 time: 0.049475 Jul 14 12:24:47.391732 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 454/894] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Jul 14 12:24:47 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments/db5f6c71-c852-45aa-b632-b1e47b09e7a3 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:47.402997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2ad28486-5879-4f05-96e2-77a6ecb65548 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:47.403491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2ad28486-5879-4f05-96e2-77a6ecb65548 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:47.407324 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:47.408476 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:47.409051 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lazy-loading 'fault' on Instance uuid bc2b616c-dc02-4d81-9eb1-028c8077a4fe {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:24:47.411144 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2ad28486-5879-4f05-96e2-77a6ecb65548 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:47.412071 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2ad28486-5879-4f05-96e2-77a6ecb65548 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:47.413647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2ad28486-5879-4f05-96e2-77a6ecb65548 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:47.414098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2ad28486-5879-4f05-96e2-77a6ecb65548 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:47.456526 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d302e57946c42d799e9bf120873eba6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb62d84584b3426687390833270648d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:47.474443 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-81cc37e7-9dbe-41b6-8562-11d6ea06feb9 tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 200 len: 1312 microversion: 2.1 time: 0.165951 Jul 14 12:24:47.475063 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 441/895] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:47 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:47.513050 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-2ad28486-5879-4f05-96e2-77a6ecb65548 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lazy-loading 'services' on Instance uuid e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:24:47.781207 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2ad28486-5879-4f05-96e2-77a6ecb65548 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments/db5f6c71-c852-45aa-b632-b1e47b09e7a3" status: 202 len: 0 microversion: 2.1 time: 0.382872 Jul 14 12:24:47.782086 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 455/896] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:24:47 2022] DELETE /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments/db5f6c71-c852-45aa-b632-b1e47b09e7a3 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:24:48.494892 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a384a393-319a-4b4f-8f26-6c0c3196ee9c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:48.495512 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a384a393-319a-4b4f-8f26-6c0c3196ee9c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] [instance: bc2b616c-dc02-4d81-9eb1-028c8077a4fe] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:48.503036 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a384a393-319a-4b4f-8f26-6c0c3196ee9c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:48.503491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a384a393-319a-4b4f-8f26-6c0c3196ee9c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:48.504276 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a384a393-319a-4b4f-8f26-6c0c3196ee9c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:48.504700 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a384a393-319a-4b4f-8f26-6c0c3196ee9c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:48.518421 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-a384a393-319a-4b4f-8f26-6c0c3196ee9c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] HTTP exception thrown: Instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe could not be found. Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a384a393-319a-4b4f-8f26-6c0c3196ee9c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Request method failure captured: Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe HTTP/1.1 Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmW5SsGlFhf_TzJg-Og2kuIVv8Fr87QiUijllnSUBvnbHpUzpWuE-rphTVE092MKeLDRhLcGVdyeyzuLP58QmtlbDaIh0UNR1NEJmPgt08fjsBh5C6AY25wIZL2k57HAqwpUFzHaNbhMhB6AWiQ5Zhrh_g09fa_3mXp-B0btNHrPWQ Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: bb62d84584b3426687390833270648d6 Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:24:48.520098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_bb62d84584b3426687390833270648d6", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/bb62d84584b3426687390833270648d6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb62d84584b3426687390833270648d6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/bb62d84584b3426687390833270648d6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: bb62d84584b3426687390833270648d6 Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1890584384 Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-ServerRescueNegativeTestJSON-1890584384-project Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 0d302e57946c42d799e9bf120873eba6 Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1890584384-project Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe could not be found. Jul 14 12:24:48.521589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'bc2b616c-dc02-4d81-9eb1-028c8077a4fe'} Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe could not be found. Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:24:48.522554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe could not be found. Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe could not be found. Jul 14 12:24:48.524163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:24:48.525718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a384a393-319a-4b4f-8f26-6c0c3196ee9c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] Returning 404 to user: Instance bc2b616c-dc02-4d81-9eb1-028c8077a4fe could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:24:48.525718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a384a393-319a-4b4f-8f26-6c0c3196ee9c tempest-ServerRescueNegativeTestJSON-1890584384 tempest-ServerRescueNegativeTestJSON-1890584384-project] 10.222.0.27 "GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe" status: 404 len: 111 microversion: 2.1 time: 0.030852 Jul 14 12:24:48.525718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 442/897] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:48 2022] GET /compute/v2.1/servers/bc2b616c-dc02-4d81-9eb1-028c8077a4fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:24:49.958192 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2656c269-2ea5-4699-9921-21379831de58 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:49.959037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2656c269-2ea5-4699-9921-21379831de58 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:49.962610 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:49.966462 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2656c269-2ea5-4699-9921-21379831de58 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:49.966959 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2656c269-2ea5-4699-9921-21379831de58 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:49.971534 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2656c269-2ea5-4699-9921-21379831de58 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:49.972216 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2656c269-2ea5-4699-9921-21379831de58 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:50.002643 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2656c269-2ea5-4699-9921-21379831de58 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments/f088b29c-08ab-4a9a-bec7-b5c71c19cbf3" status: 200 len: 194 microversion: 2.1 time: 0.050018 Jul 14 12:24:50.003980 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 456/898] 10.222.0.27 () {58 vars in 1412 bytes} [Thu Jul 14 12:24:49 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments/f088b29c-08ab-4a9a-bec7-b5c71c19cbf3 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:50.014219 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-094beefd-190f-4dcf-9718-b494a7c41c7a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:50.015728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-094beefd-190f-4dcf-9718-b494a7c41c7a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:50.024809 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-094beefd-190f-4dcf-9718-b494a7c41c7a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:50.025672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-094beefd-190f-4dcf-9718-b494a7c41c7a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:50.026465 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-094beefd-190f-4dcf-9718-b494a7c41c7a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:50.027099 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-094beefd-190f-4dcf-9718-b494a7c41c7a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:50.129065 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-094beefd-190f-4dcf-9718-b494a7c41c7a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lazy-loading 'services' on Instance uuid e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:24:50.393112 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-094beefd-190f-4dcf-9718-b494a7c41c7a tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments/f088b29c-08ab-4a9a-bec7-b5c71c19cbf3" status: 202 len: 0 microversion: 2.1 time: 0.383096 Jul 14 12:24:50.394799 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 443/899] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:24:50 2022] DELETE /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments/f088b29c-08ab-4a9a-bec7-b5c71c19cbf3 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 12:24:52.630621 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2de339e5-aa33-4a6d-a361-3a77c430d3e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:52.634944 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2de339e5-aa33-4a6d-a361-3a77c430d3e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:52.639451 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2de339e5-aa33-4a6d-a361-3a77c430d3e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:52.639913 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2de339e5-aa33-4a6d-a361-3a77c430d3e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:52.640736 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2de339e5-aa33-4a6d-a361-3a77c430d3e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:52.641172 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2de339e5-aa33-4a6d-a361-3a77c430d3e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:52.671634 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2de339e5-aa33-4a6d-a361-3a77c430d3e0 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045607 Jul 14 12:24:52.672197 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 457/900] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:52 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 12:24:52.790024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=4 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:24:52.791326 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d6285e25-e576-40cb-bcc1-1e7816fd30b8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:52.792375 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d6285e25-e576-40cb-bcc1-1e7816fd30b8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:52.798715 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d6285e25-e576-40cb-bcc1-1e7816fd30b8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:52.799212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d6285e25-e576-40cb-bcc1-1e7816fd30b8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:52.800069 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d6285e25-e576-40cb-bcc1-1e7816fd30b8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:52.800557 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d6285e25-e576-40cb-bcc1-1e7816fd30b8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:52.832627 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d6285e25-e576-40cb-bcc1-1e7816fd30b8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046786 Jul 14 12:24:52.833761 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 444/901] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:24:52 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 12:24:52.903217 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-11765ae4-d85d-450c-94b1-9c2a02e483b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:52.903795 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-11765ae4-d85d-450c-94b1-9c2a02e483b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:52.915588 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-11765ae4-d85d-450c-94b1-9c2a02e483b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:52.916692 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-11765ae4-d85d-450c-94b1-9c2a02e483b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:52.917890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-11765ae4-d85d-450c-94b1-9c2a02e483b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:52.919092 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-11765ae4-d85d-450c-94b1-9c2a02e483b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:52.953377 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-11765ae4-d85d-450c-94b1-9c2a02e483b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:24:53.305700 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-11765ae4-d85d-450c-94b1-9c2a02e483b1 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 204 len: 0 microversion: 2.1 time: 0.407550 Jul 14 12:24:53.306297 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 458/902] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:24:52 2022] DELETE /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:24:53.314605 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8d8322ff-b846-473a-97ef-0c32136b9d59 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:53.316243 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8d8322ff-b846-473a-97ef-0c32136b9d59 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:53.324133 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d8322ff-b846-473a-97ef-0c32136b9d59 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:53.324633 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d8322ff-b846-473a-97ef-0c32136b9d59 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:53.325434 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d8322ff-b846-473a-97ef-0c32136b9d59 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:53.325865 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d8322ff-b846-473a-97ef-0c32136b9d59 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:53.463997 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8d8322ff-b846-473a-97ef-0c32136b9d59 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:53.472263 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8d8322ff-b846-473a-97ef-0c32136b9d59 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1674 microversion: 2.1 time: 0.161011 Jul 14 12:24:53.472829 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 445/903] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:53 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:54.490282 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6fdc17d2-f2a2-4006-b6eb-84d0867bc299 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:54.491023 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6fdc17d2-f2a2-4006-b6eb-84d0867bc299 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:54.497635 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6fdc17d2-f2a2-4006-b6eb-84d0867bc299 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:54.498031 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6fdc17d2-f2a2-4006-b6eb-84d0867bc299 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:54.498828 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6fdc17d2-f2a2-4006-b6eb-84d0867bc299 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:54.499271 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6fdc17d2-f2a2-4006-b6eb-84d0867bc299 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:54.642329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6fdc17d2-f2a2-4006-b6eb-84d0867bc299 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:54.647304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6fdc17d2-f2a2-4006-b6eb-84d0867bc299 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1674 microversion: 2.1 time: 0.161474 Jul 14 12:24:54.647869 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 459/904] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:54 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1674 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:55.673832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-116f616f-4f29-4b09-92bf-ed9cc9788cd8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:55.674617 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-116f616f-4f29-4b09-92bf-ed9cc9788cd8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:55.691533 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-116f616f-4f29-4b09-92bf-ed9cc9788cd8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:55.692184 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-116f616f-4f29-4b09-92bf-ed9cc9788cd8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:55.692998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-116f616f-4f29-4b09-92bf-ed9cc9788cd8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:55.693442 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-116f616f-4f29-4b09-92bf-ed9cc9788cd8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:55.917678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-116f616f-4f29-4b09-92bf-ed9cc9788cd8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:55.925938 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-116f616f-4f29-4b09-92bf-ed9cc9788cd8 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1674 microversion: 2.1 time: 0.261613 Jul 14 12:24:55.926098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 446/905] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:55 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1674 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:56.668796 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-b9d0c0a5-bfa8-49e7-bb9f-505fbdabd428 req-367903d1-295e-49db-a665-610af1629507 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439", "name": "network-vif-deleted", "tag": "ee3d4bc1-a084-42b2-91b9-f0df7fc2510b"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:24:56.678443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-b9d0c0a5-bfa8-49e7-bb9f-505fbdabd428 req-367903d1-295e-49db-a665-610af1629507 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:56.681357 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-b9d0c0a5-bfa8-49e7-bb9f-505fbdabd428 req-367903d1-295e-49db-a665-610af1629507 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:56.689974 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-b9d0c0a5-bfa8-49e7-bb9f-505fbdabd428 req-367903d1-295e-49db-a665-610af1629507 service nova] Creating event network-vif-deleted:ee3d4bc1-a084-42b2-91b9-f0df7fc2510b for instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 on hv-cinder-84890 Jul 14 12:24:56.694903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-b9d0c0a5-bfa8-49e7-bb9f-505fbdabd428 req-367903d1-295e-49db-a665-610af1629507 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030592 Jul 14 12:24:56.695809 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 460/906] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:24:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:24:56.944911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-983f4102-b869-4581-83fb-01b81fdd8849 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:56.945670 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-983f4102-b869-4581-83fb-01b81fdd8849 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:56.956371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-983f4102-b869-4581-83fb-01b81fdd8849 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:56.959089 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-983f4102-b869-4581-83fb-01b81fdd8849 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:56.959089 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-983f4102-b869-4581-83fb-01b81fdd8849 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:56.959089 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-983f4102-b869-4581-83fb-01b81fdd8849 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:57.030371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-983f4102-b869-4581-83fb-01b81fdd8849 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6da4b0616034aa1bb22c44a8f5ef280', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33b09a1d039248aa95a089c8d8d99c68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:24:57.038341 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-983f4102-b869-4581-83fb-01b81fdd8849 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 200 len: 1322 microversion: 2.1 time: 0.099857 Jul 14 12:24:57.038969 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 447/907] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:56 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 1322 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:24:58.056893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-15cca2f0-2509-4820-abd5-062ffdafa687 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:58.057641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-15cca2f0-2509-4820-abd5-062ffdafa687 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:24:58.063938 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-15cca2f0-2509-4820-abd5-062ffdafa687 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:58.064384 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-15cca2f0-2509-4820-abd5-062ffdafa687 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:58.065139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-15cca2f0-2509-4820-abd5-062ffdafa687 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:24:58.065571 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-15cca2f0-2509-4820-abd5-062ffdafa687 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:24:58.079032 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-15cca2f0-2509-4820-abd5-062ffdafa687 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] HTTP exception thrown: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-15cca2f0-2509-4820-abd5-062ffdafa687 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Request method failure captured: Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 HTTP/1.1 Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AmNs7D8VSwR_-yNd_GBcPDVcneSBSiG5-fSaXfVjjGNbhDdXqCe9-lbEMbFx3XhSNwHomxn3h-GB9dMb5fL7AKbYScFosTfsgsRxy3XD3PrGLkUfp6vpotyjkVj97YJeH9I5KYc4y4EYjqAK_WFStx4CtAyI5GIg6erxhUcBVLiweM Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:24:58.080613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33b09a1d039248aa95a089c8d8d99c68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: d6da4b0616034aa1bb22c44a8f5ef280 Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:24:58.083001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439'} Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:24:58.083948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:24:58.085443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:24:58.086789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-15cca2f0-2509-4820-abd5-062ffdafa687 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Returning 404 to user: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:24:58.086789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-15cca2f0-2509-4820-abd5-062ffdafa687 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 404 len: 111 microversion: 2.1 time: 0.030196 Jul 14 12:24:58.086789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 461/908] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:24:58 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:24:58.091514 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e0b8198e-3ba3-472f-ba19-7d2b1e903ae4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '.version_select at 0x7f0e2649fe50>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:24:58.192986 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e0b8198e-3ba3-472f-ba19-7d2b1e903ae4 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758254479" status: 202 len: 0 microversion: 2.1 time: 0.105330 Jul 14 12:24:58.193569 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 448/909] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jul 14 12:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1758254479 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:25:04.842872 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-7db0ea04-97d4-42ff-9222-98587aefee09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:04.843372 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-7db0ea04-97d4-42ff-9222-98587aefee09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:04.849971 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7db0ea04-97d4-42ff-9222-98587aefee09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:04.850427 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7db0ea04-97d4-42ff-9222-98587aefee09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:04.851223 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7db0ea04-97d4-42ff-9222-98587aefee09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:04.852313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7db0ea04-97d4-42ff-9222-98587aefee09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:04.867789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-7db0ea04-97d4-42ff-9222-98587aefee09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] HTTP exception thrown: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-7db0ea04-97d4-42ff-9222-98587aefee09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Request method failure captured: Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: DELETE /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 HTTP/1.1 Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AmNs7D8VSwR_-yNd_GBcPDVcneSBSiG5-fSaXfVjjGNbhDdXqCe9-lbEMbFx3XhSNwHomxn3h-GB9dMb5fL7AKbYScFosTfsgsRxy3XD3PrGLkUfp6vpotyjkVj97YJeH9I5KYc4y4EYjqAK_WFStx4CtAyI5GIg6erxhUcBVLiweM Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:25:04.869329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33b09a1d039248aa95a089c8d8d99c68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: d6da4b0616034aa1bb22c44a8f5ef280 Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:25:04.870902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439'} Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:25:04.871762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:25:04.873149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:25:04.874526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-7db0ea04-97d4-42ff-9222-98587aefee09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Returning 404 to user: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:25:04.874526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-7db0ea04-97d4-42ff-9222-98587aefee09 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "DELETE /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 404 len: 111 microversion: 2.1 time: 0.031657 Jul 14 12:25:04.874526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 462/910] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:25:04 2022] DELETE /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:25:04.878994 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e9725c46-4db0-4c36-9a67-338a4e1e373d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:04.879609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e9725c46-4db0-4c36-9a67-338a4e1e373d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:04.886241 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e9725c46-4db0-4c36-9a67-338a4e1e373d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:04.886690 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e9725c46-4db0-4c36-9a67-338a4e1e373d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:04.887492 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e9725c46-4db0-4c36-9a67-338a4e1e373d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:04.887929 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e9725c46-4db0-4c36-9a67-338a4e1e373d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:04.901073 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-e9725c46-4db0-4c36-9a67-338a4e1e373d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] HTTP exception thrown: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e9725c46-4db0-4c36-9a67-338a4e1e373d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Request method failure captured: Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 HTTP/1.1 Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmNs7D8VSwR_-yNd_GBcPDVcneSBSiG5-fSaXfVjjGNbhDdXqCe9-lbEMbFx3XhSNwHomxn3h-GB9dMb5fL7AKbYScFosTfsgsRxy3XD3PrGLkUfp6vpotyjkVj97YJeH9I5KYc4y4EYjqAK_WFStx4CtAyI5GIg6erxhUcBVLiweM Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:25:04.902699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33b09a1d039248aa95a089c8d8d99c68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: d6da4b0616034aa1bb22c44a8f5ef280 Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:25:04.904309 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439'} Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:25:04.905077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. Jul 14 12:25:04.906283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:04.907789 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e9725c46-4db0-4c36-9a67-338a4e1e373d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Returning 404 to user: Instance e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:25:04.907789 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e9725c46-4db0-4c36-9a67-338a4e1e373d tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439" status: 404 len: 111 microversion: 2.1 time: 0.028937 Jul 14 12:25:04.907789 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 449/911] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:04 2022] GET /compute/v2.1/servers/e3e8a396-43d2-4d4f-8fb5-cc8b9fbe7439 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 12:25:05.496294 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1392142392", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153859730", "security_groups": [{"name": "tempest-secgroup-smoke-1834465563"}], "block_device_mapping_v2": [{"uuid": "89bb2c8b-00f8-4d38-9802-e6d3d542b548", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e86e92bf-9b7d-465e-8fb7-65ffe1a278e1"}]}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:05.614650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.network.neutron [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] validate_networks() for [('e86e92bf-9b7d-465e-8fb7-65ffe1a278e1', None, None, None, None, None)] {{(pid=118262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:25:06.079037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Flavor limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:25:06.079615 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Image limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:25:06.079936 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Flavor pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:25:06.080352 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Image pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:25:06.080796 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:25:06.089485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:06.089927 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:06.093805 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:06.093805 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:06.107953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Getting quotas for project c0d098ca721b409385a08b91d861b295. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:25:06.111877 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Getting quotas for user d0adaa092d944202b3279d10e0f94a91 and project c0d098ca721b409385a08b91d861b295. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:25:06.170750 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Going to run 1 instances... {{(pid=118262) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:25:06.174377 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89bb2c8b-00f8-4d38-9802-e6d3d542b548',volume_size=None,volume_type=None)] {{(pid=118262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:25:06.181424 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-277fe2e2-ffb6-42b5-a994-24f2b1eb2090 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:06.182117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-277fe2e2-ffb6-42b5-a994-24f2b1eb2090 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:06.189264 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-277fe2e2-ffb6-42b5-a994-24f2b1eb2090 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:06.189808 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-277fe2e2-ffb6-42b5-a994-24f2b1eb2090 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:06.191324 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-277fe2e2-ffb6-42b5-a994-24f2b1eb2090 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:06.194699 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-277fe2e2-ffb6-42b5-a994-24f2b1eb2090 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:06.207018 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-277fe2e2-ffb6-42b5-a994-24f2b1eb2090 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] HTTP exception thrown: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-277fe2e2-ffb6-42b5-a994-24f2b1eb2090 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Request method failure captured: Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: DELETE /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 HTTP/1.1 Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmNs7D8VSwR_-yNd_GBcPDVcneSBSiG5-fSaXfVjjGNbhDdXqCe9-lbEMbFx3XhSNwHomxn3h-GB9dMb5fL7AKbYScFosTfsgsRxy3XD3PrGLkUfp6vpotyjkVj97YJeH9I5KYc4y4EYjqAK_WFStx4CtAyI5GIg6erxhUcBVLiweM Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:25:06.208585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33b09a1d039248aa95a089c8d8d99c68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: d6da4b0616034aa1bb22c44a8f5ef280 Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:25:06.209985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'd2634876-d37b-4436-9c61-23c72f9be7f0'} Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:25:06.210883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:25:06.212889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:06.214136 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-277fe2e2-ffb6-42b5-a994-24f2b1eb2090 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Returning 404 to user: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:25:06.214136 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-277fe2e2-ffb6-42b5-a994-24f2b1eb2090 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 404 len: 111 microversion: 2.1 time: 0.034354 Jul 14 12:25:06.214136 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 450/912] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:25:06 2022] DELETE /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:25:06.219426 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-774c8d87-53ee-4566-b8dd-cf68f88aed14 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:06.229022 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-774c8d87-53ee-4566-b8dd-cf68f88aed14 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] [instance: d2634876-d37b-4436-9c61-23c72f9be7f0] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:06.229022 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-774c8d87-53ee-4566-b8dd-cf68f88aed14 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:06.229022 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-774c8d87-53ee-4566-b8dd-cf68f88aed14 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:06.229022 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-774c8d87-53ee-4566-b8dd-cf68f88aed14 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:06.229395 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-774c8d87-53ee-4566-b8dd-cf68f88aed14 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:06.241314 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-774c8d87-53ee-4566-b8dd-cf68f88aed14 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] HTTP exception thrown: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-774c8d87-53ee-4566-b8dd-cf68f88aed14 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Request method failure captured: Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 HTTP/1.1 Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AmNs7D8VSwR_-yNd_GBcPDVcneSBSiG5-fSaXfVjjGNbhDdXqCe9-lbEMbFx3XhSNwHomxn3h-GB9dMb5fL7AKbYScFosTfsgsRxy3XD3PrGLkUfp6vpotyjkVj97YJeH9I5KYc4y4EYjqAK_WFStx4CtAyI5GIg6erxhUcBVLiweM Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:25:06.243625 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_33b09a1d039248aa95a089c8d8d99c68", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/33b09a1d039248aa95a089c8d8d99c68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 33b09a1d039248aa95a089c8d8d99c68 Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1362085785 Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: d6da4b0616034aa1bb22c44a8f5ef280 Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeTestJSON-1362085785-project Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:25:06.245287 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'd2634876-d37b-4436-9c61-23c72f9be7f0'} Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:25:06.246285 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. Jul 14 12:25:06.247777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:06.249292 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-774c8d87-53ee-4566-b8dd-cf68f88aed14 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] Returning 404 to user: Instance d2634876-d37b-4436-9c61-23c72f9be7f0 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:25:06.249292 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-774c8d87-53ee-4566-b8dd-cf68f88aed14 tempest-AttachVolumeTestJSON-1362085785 tempest-AttachVolumeTestJSON-1362085785-project] 10.222.0.27 "GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0" status: 404 len: 111 microversion: 2.1 time: 0.029453 Jul 14 12:25:06.249292 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 451/913] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:06 2022] GET /compute/v2.1/servers/d2634876-d37b-4436-9c61-23c72f9be7f0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 12:25:06.586536 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-eef37ca0-bf55-4aa5-aa8a-1320ad4b14ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.094174 Jul 14 12:25:06.588046 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 463/914] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:25:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:25:06.604685 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d4b84e99-c6bd-483f-a32c-033dfcc2bf20 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:06.606320 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d4b84e99-c6bd-483f-a32c-033dfcc2bf20 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:06.679242 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d4b84e99-c6bd-483f-a32c-033dfcc2bf20 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:06.690718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d4b84e99-c6bd-483f-a32c-033dfcc2bf20 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1094 microversion: 2.1 time: 0.092273 Jul 14 12:25:06.699091 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 452/915] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:06 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1094 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:07.709497 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-660093ba-2bd2-48bf-8020-0b56cfed78bf tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:07.710094 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-660093ba-2bd2-48bf-8020-0b56cfed78bf tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:07.792177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-660093ba-2bd2-48bf-8020-0b56cfed78bf tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:07.799106 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-660093ba-2bd2-48bf-8020-0b56cfed78bf tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1094 microversion: 2.1 time: 0.093887 Jul 14 12:25:07.799667 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 464/916] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:07 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:08.825800 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-121d0093-7d6e-46c8-bec4-93a824fd62c2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:08.826566 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-121d0093-7d6e-46c8-bec4-93a824fd62c2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:08.834920 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-121d0093-7d6e-46c8-bec4-93a824fd62c2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:08.838975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-121d0093-7d6e-46c8-bec4-93a824fd62c2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:08.838975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-121d0093-7d6e-46c8-bec4-93a824fd62c2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:08.838975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-121d0093-7d6e-46c8-bec4-93a824fd62c2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:08.904830 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-121d0093-7d6e-46c8-bec4-93a824fd62c2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:08.928049 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-121d0093-7d6e-46c8-bec4-93a824fd62c2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1192 microversion: 2.1 time: 0.115686 Jul 14 12:25:08.930807 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 453/917] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:08 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:09.904966 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3756375d-89f6-41fc-a181-170060d48cd5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:09.906023 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3756375d-89f6-41fc-a181-170060d48cd5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:09.916374 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3756375d-89f6-41fc-a181-170060d48cd5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:09.916824 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3756375d-89f6-41fc-a181-170060d48cd5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:09.917606 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3756375d-89f6-41fc-a181-170060d48cd5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:09.918470 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3756375d-89f6-41fc-a181-170060d48cd5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:09.923772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:09.949670 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3756375d-89f6-41fc-a181-170060d48cd5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/ips" status: 200 len: 151 microversion: 2.20 time: 0.425898 Jul 14 12:25:09.950549 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 465/918] 10.222.0.27 () {60 vars in 1288 bytes} [Thu Jul 14 12:25:09 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/ips => generated 151 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 12:25:09.951752 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-485f3e23-e2bf-42ea-b06e-530b9fff2383 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:09.952725 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-485f3e23-e2bf-42ea-b06e-530b9fff2383 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:09.962335 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-485f3e23-e2bf-42ea-b06e-530b9fff2383 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:09.962810 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-485f3e23-e2bf-42ea-b06e-530b9fff2383 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:09.963589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-485f3e23-e2bf-42ea-b06e-530b9fff2383 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:09.975612 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-485f3e23-e2bf-42ea-b06e-530b9fff2383 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:09.989361 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:10.252223 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-485f3e23-e2bf-42ea-b06e-530b9fff2383 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:10.260471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-485f3e23-e2bf-42ea-b06e-530b9fff2383 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1210 microversion: 2.1 time: 0.317596 Jul 14 12:25:10.263536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 454/919] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:09 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1210 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:11.281827 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-491d8a6a-742a-4a90-b6a5-6e872cfbb787 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:11.282596 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-491d8a6a-742a-4a90-b6a5-6e872cfbb787 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:11.291971 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-491d8a6a-742a-4a90-b6a5-6e872cfbb787 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:11.292586 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-491d8a6a-742a-4a90-b6a5-6e872cfbb787 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:11.293786 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-491d8a6a-742a-4a90-b6a5-6e872cfbb787 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:11.294377 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-491d8a6a-742a-4a90-b6a5-6e872cfbb787 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:11.442987 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-491d8a6a-742a-4a90-b6a5-6e872cfbb787 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:11.453702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-491d8a6a-742a-4a90-b6a5-6e872cfbb787 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1278 microversion: 2.1 time: 0.176732 Jul 14 12:25:11.455017 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 466/920] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:11 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:11.902120 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-658594e0-d1d2-483d-b681-438c3c494cc8 req-26bdc46e-f2de-45be-9ac4-024d4ccdc310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9973bd5-77cb-4f58-8c30-5d0715218db6", "tag": "90f6fd17-e1da-4664-af50-c1a16671d7a0"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:11.914371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-658594e0-d1d2-483d-b681-438c3c494cc8 req-26bdc46e-f2de-45be-9ac4-024d4ccdc310 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:11.919007 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-658594e0-d1d2-483d-b681-438c3c494cc8 req-26bdc46e-f2de-45be-9ac4-024d4ccdc310 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:11.927366 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-658594e0-d1d2-483d-b681-438c3c494cc8 req-26bdc46e-f2de-45be-9ac4-024d4ccdc310 service nova] Creating event network-changed:90f6fd17-e1da-4664-af50-c1a16671d7a0 for instance c9973bd5-77cb-4f58-8c30-5d0715218db6 on hv-cinder-84890 Jul 14 12:25:11.933654 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-658594e0-d1d2-483d-b681-438c3c494cc8 req-26bdc46e-f2de-45be-9ac4-024d4ccdc310 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041490 Jul 14 12:25:11.934249 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 455/921] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:25:12.471135 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-db007d2a-de60-4d6a-bc2b-2365506f95b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:12.472274 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-db007d2a-de60-4d6a-bc2b-2365506f95b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:12.480434 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-db007d2a-de60-4d6a-bc2b-2365506f95b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:12.481155 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-db007d2a-de60-4d6a-bc2b-2365506f95b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:12.482130 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-db007d2a-de60-4d6a-bc2b-2365506f95b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:12.482755 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-db007d2a-de60-4d6a-bc2b-2365506f95b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:12.622105 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-db007d2a-de60-4d6a-bc2b-2365506f95b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:12.634259 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-db007d2a-de60-4d6a-bc2b-2365506f95b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.167208 Jul 14 12:25:12.635473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 467/922] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:12 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:13.036882 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4e5ccf72-7936-4343-bf81-d678ac56aee2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:13.037506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4e5ccf72-7936-4343-bf81-d678ac56aee2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:13.044728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4e5ccf72-7936-4343-bf81-d678ac56aee2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:13.045177 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4e5ccf72-7936-4343-bf81-d678ac56aee2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:13.045940 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4e5ccf72-7936-4343-bf81-d678ac56aee2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:13.046378 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4e5ccf72-7936-4343-bf81-d678ac56aee2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:13.068584 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-4e5ccf72-7936-4343-bf81-d678ac56aee2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lazy-loading 'flavor' on Instance uuid a356720e-5371-4d02-bd6d-5293e39ed68a {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:25:13.609263 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4e5ccf72-7936-4343-bf81-d678ac56aee2 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "POST /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/action" status: 202 len: 0 microversion: 2.20 time: 0.576809 Jul 14 12:25:13.613088 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 456/923] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jul 14 12:25:13 2022] POST /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/action => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:25:13.619903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4d902e6a-94e4-4f7c-bb1e-4894d91d09f6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:13.620760 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4d902e6a-94e4-4f7c-bb1e-4894d91d09f6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:13.627907 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4d902e6a-94e4-4f7c-bb1e-4894d91d09f6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:13.628387 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4d902e6a-94e4-4f7c-bb1e-4894d91d09f6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:13.629183 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4d902e6a-94e4-4f7c-bb1e-4894d91d09f6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:13.629612 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4d902e6a-94e4-4f7c-bb1e-4894d91d09f6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:13.654942 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c34f27b1-39b0-455b-9364-c12e3675dd1d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:13.655747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c34f27b1-39b0-455b-9364-c12e3675dd1d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:13.662798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c34f27b1-39b0-455b-9364-c12e3675dd1d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:13.664199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c34f27b1-39b0-455b-9364-c12e3675dd1d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:13.665029 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c34f27b1-39b0-455b-9364-c12e3675dd1d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:13.665470 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c34f27b1-39b0-455b-9364-c12e3675dd1d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:13.775317 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4d902e6a-94e4-4f7c-bb1e-4894d91d09f6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:13.784540 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4d902e6a-94e4-4f7c-bb1e-4894d91d09f6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:13.786455 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4d902e6a-94e4-4f7c-bb1e-4894d91d09f6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:13.787925 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4d902e6a-94e4-4f7c-bb1e-4894d91d09f6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.173448 Jul 14 12:25:13.789240 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 468/924] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:13 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:25:13.900026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c34f27b1-39b0-455b-9364-c12e3675dd1d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:13.908582 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c34f27b1-39b0-455b-9364-c12e3675dd1d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.257801 Jul 14 12:25:13.909161 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 457/925] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:13 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:25:14.807765 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b283d208-d9b1-4961-aaab-e8ab14c9ed72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:14.808517 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b283d208-d9b1-4961-aaab-e8ab14c9ed72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:14.815450 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b283d208-d9b1-4961-aaab-e8ab14c9ed72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:14.816279 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b283d208-d9b1-4961-aaab-e8ab14c9ed72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:14.817155 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b283d208-d9b1-4961-aaab-e8ab14c9ed72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:14.817788 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b283d208-d9b1-4961-aaab-e8ab14c9ed72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:14.925332 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ac1b925f-cccf-4f86-a1ea-bd5c6ea98bf9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:14.927204 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ac1b925f-cccf-4f86-a1ea-bd5c6ea98bf9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:14.933487 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ac1b925f-cccf-4f86-a1ea-bd5c6ea98bf9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:14.934158 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ac1b925f-cccf-4f86-a1ea-bd5c6ea98bf9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:14.935177 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ac1b925f-cccf-4f86-a1ea-bd5c6ea98bf9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:14.935922 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ac1b925f-cccf-4f86-a1ea-bd5c6ea98bf9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:14.968526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b283d208-d9b1-4961-aaab-e8ab14c9ed72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:14.978031 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b283d208-d9b1-4961-aaab-e8ab14c9ed72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:14.979664 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b283d208-d9b1-4961-aaab-e8ab14c9ed72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:14.980920 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b283d208-d9b1-4961-aaab-e8ab14c9ed72 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.177375 Jul 14 12:25:14.981579 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 469/926] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:14 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:15.167098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ac1b925f-cccf-4f86-a1ea-bd5c6ea98bf9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:15.175399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ac1b925f-cccf-4f86-a1ea-bd5c6ea98bf9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.253450 Jul 14 12:25:15.176444 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 458/927] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:14 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:15.999807 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9041f801-e020-4b60-82a8-7332f834401d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:16.000546 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-9041f801-e020-4b60-82a8-7332f834401d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:16.007237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9041f801-e020-4b60-82a8-7332f834401d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:16.007680 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9041f801-e020-4b60-82a8-7332f834401d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:16.008779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9041f801-e020-4b60-82a8-7332f834401d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:16.009395 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9041f801-e020-4b60-82a8-7332f834401d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:16.104420 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:16.163830 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9041f801-e020-4b60-82a8-7332f834401d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:16.175865 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9041f801-e020-4b60-82a8-7332f834401d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:16.177365 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9041f801-e020-4b60-82a8-7332f834401d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:16.178537 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9041f801-e020-4b60-82a8-7332f834401d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.182786 Jul 14 12:25:16.179111 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 470/928] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:15 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:16.193868 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ed7b0d3e-73bb-4598-97d1-d2bc7139faa6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:16.195035 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ed7b0d3e-73bb-4598-97d1-d2bc7139faa6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:16.202047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ed7b0d3e-73bb-4598-97d1-d2bc7139faa6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:16.204444 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ed7b0d3e-73bb-4598-97d1-d2bc7139faa6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:16.205976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ed7b0d3e-73bb-4598-97d1-d2bc7139faa6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:16.206425 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ed7b0d3e-73bb-4598-97d1-d2bc7139faa6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:16.437718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ed7b0d3e-73bb-4598-97d1-d2bc7139faa6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:16.446001 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ed7b0d3e-73bb-4598-97d1-d2bc7139faa6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.257227 Jul 14 12:25:16.446933 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 459/929] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:16 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:17.197500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9086c047-3db6-478b-8b94-71dfe030990d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:17.198959 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-9086c047-3db6-478b-8b94-71dfe030990d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:17.206553 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9086c047-3db6-478b-8b94-71dfe030990d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:17.206553 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9086c047-3db6-478b-8b94-71dfe030990d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:17.207137 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9086c047-3db6-478b-8b94-71dfe030990d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:17.207676 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9086c047-3db6-478b-8b94-71dfe030990d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:17.355944 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9086c047-3db6-478b-8b94-71dfe030990d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:17.364713 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9086c047-3db6-478b-8b94-71dfe030990d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:17.366264 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9086c047-3db6-478b-8b94-71dfe030990d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:17.367506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9086c047-3db6-478b-8b94-71dfe030990d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.174389 Jul 14 12:25:17.368068 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 471/930] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:17 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:25:17.464676 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e7fb76cb-b505-4530-af90-765229e05aeb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:17.466482 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e7fb76cb-b505-4530-af90-765229e05aeb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:17.468531 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:17.473914 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e7fb76cb-b505-4530-af90-765229e05aeb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:17.474362 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e7fb76cb-b505-4530-af90-765229e05aeb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:17.475450 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e7fb76cb-b505-4530-af90-765229e05aeb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:17.476015 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e7fb76cb-b505-4530-af90-765229e05aeb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:17.654721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e7fb76cb-b505-4530-af90-765229e05aeb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:17.662432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e7fb76cb-b505-4530-af90-765229e05aeb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.203052 Jul 14 12:25:17.663064 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 460/931] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:17 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:18.386268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b2c54224-7648-4f18-bfee-565ca5194de7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:18.386910 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b2c54224-7648-4f18-bfee-565ca5194de7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:18.388798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=8 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:18.395685 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2c54224-7648-4f18-bfee-565ca5194de7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:18.396148 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2c54224-7648-4f18-bfee-565ca5194de7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:18.396935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2c54224-7648-4f18-bfee-565ca5194de7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:18.397372 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b2c54224-7648-4f18-bfee-565ca5194de7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:18.557834 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b2c54224-7648-4f18-bfee-565ca5194de7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:18.571836 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b2c54224-7648-4f18-bfee-565ca5194de7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:18.573120 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b2c54224-7648-4f18-bfee-565ca5194de7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:18.574351 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b2c54224-7648-4f18-bfee-565ca5194de7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.192567 Jul 14 12:25:18.575532 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 472/932] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:18 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:18.679946 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-270adae6-be6e-4980-baa3-f263e11e0c5d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:18.681324 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-270adae6-be6e-4980-baa3-f263e11e0c5d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:18.683988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:18.689985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-270adae6-be6e-4980-baa3-f263e11e0c5d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:18.691379 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-270adae6-be6e-4980-baa3-f263e11e0c5d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:18.692385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-270adae6-be6e-4980-baa3-f263e11e0c5d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:18.693936 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-270adae6-be6e-4980-baa3-f263e11e0c5d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:18.874428 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-270adae6-be6e-4980-baa3-f263e11e0c5d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:18.883945 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-270adae6-be6e-4980-baa3-f263e11e0c5d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.206187 Jul 14 12:25:18.884543 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 461/933] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:18 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:19.067161 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-02c18ad8-0879-4e09-88cb-9a541da57d7c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: .version_select at 0x7f0e2671a670>, body: {"keypair": {"name": "tempest-keypair-958647737", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/rlymYUVFd/eunmP7qWLZipOeWpQwOcQEr5htPc9yeZBj/kBnt+R8aOUUwXljhfExjwYO+pFn3LLlI1juN8OrwcIZO9iKGG2KbBcIDdAI649tupkZI4hqTh/B9Khra7g=="}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:19.087866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-02c18ad8-0879-4e09-88cb-9a541da57d7c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'key_pairs'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:25:19.092125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-02c18ad8-0879-4e09-88cb-9a541da57d7c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for user 8d824401d1454a2bb19d7628e38b256a and project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'key_pairs'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:25:19.174857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-02c18ad8-0879-4e09-88cb-9a541da57d7c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.236528 Jul 14 12:25:19.175469 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 473/934] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 12:25:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:25:19.594045 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d590b8d0-cd7c-4c4b-8321-5e2757a5b42d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:19.594734 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d590b8d0-cd7c-4c4b-8321-5e2757a5b42d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:19.601644 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d590b8d0-cd7c-4c4b-8321-5e2757a5b42d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:19.607645 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d590b8d0-cd7c-4c4b-8321-5e2757a5b42d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:19.607645 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d590b8d0-cd7c-4c4b-8321-5e2757a5b42d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:19.607645 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d590b8d0-cd7c-4c4b-8321-5e2757a5b42d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:19.763155 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d590b8d0-cd7c-4c4b-8321-5e2757a5b42d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:19.774026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d590b8d0-cd7c-4c4b-8321-5e2757a5b42d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:19.775531 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d590b8d0-cd7c-4c4b-8321-5e2757a5b42d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:19.776687 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d590b8d0-cd7c-4c4b-8321-5e2757a5b42d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.187541 Jul 14 12:25:19.777241 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 462/935] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:19 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:19.901076 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f8801533-fab6-4a22-91d1-10a4bf63cb30 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:19.901690 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f8801533-fab6-4a22-91d1-10a4bf63cb30 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:19.908246 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8801533-fab6-4a22-91d1-10a4bf63cb30 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:19.908695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8801533-fab6-4a22-91d1-10a4bf63cb30 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:19.909582 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8801533-fab6-4a22-91d1-10a4bf63cb30 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:19.910016 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8801533-fab6-4a22-91d1-10a4bf63cb30 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:20.055555 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f8801533-fab6-4a22-91d1-10a4bf63cb30 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:20.061236 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f8801533-fab6-4a22-91d1-10a4bf63cb30 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.164699 Jul 14 12:25:20.062001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 474/936] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:19 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:20.795028 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-abc21f72-8042-4794-98df-b804756bf270 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:20.795643 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-abc21f72-8042-4794-98df-b804756bf270 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:20.802114 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-abc21f72-8042-4794-98df-b804756bf270 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:20.817237 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-abc21f72-8042-4794-98df-b804756bf270 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:20.817237 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-abc21f72-8042-4794-98df-b804756bf270 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:20.817237 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-abc21f72-8042-4794-98df-b804756bf270 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:20.968133 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-abc21f72-8042-4794-98df-b804756bf270 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:20.984418 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-abc21f72-8042-4794-98df-b804756bf270 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:20.986416 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-abc21f72-8042-4794-98df-b804756bf270 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:20.988301 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-abc21f72-8042-4794-98df-b804756bf270 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.197136 Jul 14 12:25:20.990117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 463/937] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:20 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:21.078749 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-22c6d722-1339-4a27-80b9-b5685f91ba53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:21.079762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-22c6d722-1339-4a27-80b9-b5685f91ba53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:21.086199 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-22c6d722-1339-4a27-80b9-b5685f91ba53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:21.086502 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-22c6d722-1339-4a27-80b9-b5685f91ba53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:21.087313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-22c6d722-1339-4a27-80b9-b5685f91ba53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:21.087752 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-22c6d722-1339-4a27-80b9-b5685f91ba53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:21.234235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-22c6d722-1339-4a27-80b9-b5685f91ba53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:21.241986 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-22c6d722-1339-4a27-80b9-b5685f91ba53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.167185 Jul 14 12:25:21.252788 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 475/938] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:21 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:21.508302 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1244819951", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "738fa312-d388-4da8-be3f-aad30d233548"}], "security_groups": [{"name": "tempest-securitygroup--307995992"}], "key_name": "tempest-keypair-958647737", "user_data": "}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:21.615507 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] validate_networks() for [('738fa312-d388-4da8-be3f-aad30d233548', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:25:22.007210 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d34dd6e5-e670-4cd7-8ad4-f62fa00519b6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:22.012439 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d34dd6e5-e670-4cd7-8ad4-f62fa00519b6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:22.019410 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d34dd6e5-e670-4cd7-8ad4-f62fa00519b6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:22.020163 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d34dd6e5-e670-4cd7-8ad4-f62fa00519b6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:22.021160 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d34dd6e5-e670-4cd7-8ad4-f62fa00519b6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:22.021792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d34dd6e5-e670-4cd7-8ad4-f62fa00519b6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:22.181927 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d34dd6e5-e670-4cd7-8ad4-f62fa00519b6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:22.191838 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d34dd6e5-e670-4cd7-8ad4-f62fa00519b6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:22.201188 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d34dd6e5-e670-4cd7-8ad4-f62fa00519b6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:22.202404 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d34dd6e5-e670-4cd7-8ad4-f62fa00519b6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.199186 Jul 14 12:25:22.203373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 476/939] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:22 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:22.260255 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0e4cd89d-7abb-4497-8ce5-5b21bdc84fc2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:22.260974 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0e4cd89d-7abb-4497-8ce5-5b21bdc84fc2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:22.270540 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0e4cd89d-7abb-4497-8ce5-5b21bdc84fc2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:22.274949 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0e4cd89d-7abb-4497-8ce5-5b21bdc84fc2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:22.276312 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0e4cd89d-7abb-4497-8ce5-5b21bdc84fc2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:22.277061 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0e4cd89d-7abb-4497-8ce5-5b21bdc84fc2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:22.424169 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:25:22.424622 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:25:22.425488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:25:22.426079 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:25:22.426692 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:25:22.437810 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:22.438558 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:22.439563 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:22.440238 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:22.463518 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0e4cd89d-7abb-4497-8ce5-5b21bdc84fc2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:22.473349 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:25:22.473960 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0e4cd89d-7abb-4497-8ce5-5b21bdc84fc2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.216682 Jul 14 12:25:22.474706 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 477/940] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:22 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:22.480057 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for user 8d824401d1454a2bb19d7628e38b256a and project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:25:22.494214 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:25:22.497135 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:25:22.616313 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2f4ff98f-cf5a-466f-b20d-39e078664d53 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.112518 Jul 14 12:25:22.618389 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 464/941] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:25:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:25:22.628363 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-72b7bff9-e302-432a-b093-5731c4cdc2da tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:22.629253 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-72b7bff9-e302-432a-b093-5731c4cdc2da tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:22.688505 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-72b7bff9-e302-432a-b093-5731c4cdc2da tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:22.695915 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-72b7bff9-e302-432a-b093-5731c4cdc2da tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1241 microversion: 2.1 time: 0.071072 Jul 14 12:25:22.696495 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 478/942] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:22 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:23.221365 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-faf31cfb-be6f-4336-9c4a-7aa19e16318b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:23.221981 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-faf31cfb-be6f-4336-9c4a-7aa19e16318b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:23.230229 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-faf31cfb-be6f-4336-9c4a-7aa19e16318b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:23.232347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-faf31cfb-be6f-4336-9c4a-7aa19e16318b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:23.232347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-faf31cfb-be6f-4336-9c4a-7aa19e16318b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:23.232347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-faf31cfb-be6f-4336-9c4a-7aa19e16318b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:23.375681 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-faf31cfb-be6f-4336-9c4a-7aa19e16318b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:23.384265 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-faf31cfb-be6f-4336-9c4a-7aa19e16318b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:23.385785 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-faf31cfb-be6f-4336-9c4a-7aa19e16318b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:23.387178 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-faf31cfb-be6f-4336-9c4a-7aa19e16318b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.170251 Jul 14 12:25:23.387736 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 465/943] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:23 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:23.490857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f8da973f-709c-46dd-b924-87e87cdb8b49 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:23.491412 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f8da973f-709c-46dd-b924-87e87cdb8b49 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:23.493961 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:23.499669 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8da973f-709c-46dd-b924-87e87cdb8b49 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:23.500134 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8da973f-709c-46dd-b924-87e87cdb8b49 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:23.500907 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8da973f-709c-46dd-b924-87e87cdb8b49 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:23.501346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f8da973f-709c-46dd-b924-87e87cdb8b49 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:23.636430 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f8da973f-709c-46dd-b924-87e87cdb8b49 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:23.644222 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f8da973f-709c-46dd-b924-87e87cdb8b49 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.157335 Jul 14 12:25:23.644893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 479/944] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:23 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:23.713356 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-41559208-9035-481d-adb1-2d6db71a322c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:23.714059 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-41559208-9035-481d-adb1-2d6db71a322c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:23.720270 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41559208-9035-481d-adb1-2d6db71a322c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:23.720721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41559208-9035-481d-adb1-2d6db71a322c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:23.721492 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41559208-9035-481d-adb1-2d6db71a322c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:23.721955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-41559208-9035-481d-adb1-2d6db71a322c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:23.786053 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-41559208-9035-481d-adb1-2d6db71a322c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:23.798822 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-41559208-9035-481d-adb1-2d6db71a322c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1245 microversion: 2.1 time: 0.088581 Jul 14 12:25:23.798822 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 466/945] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:23 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:23.876165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-3c3f2573-43d5-4573-b763-b1fbe4bdc4b6 req-36b8376a-214d-43f5-aad2-2007e77f8683 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9973bd5-77cb-4f58-8c30-5d0715218db6", "name": "network-vif-plugged", "status": "completed", "tag": "90f6fd17-e1da-4664-af50-c1a16671d7a0"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:23.888181 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-3c3f2573-43d5-4573-b763-b1fbe4bdc4b6 req-36b8376a-214d-43f5-aad2-2007e77f8683 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:23.888951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-3c3f2573-43d5-4573-b763-b1fbe4bdc4b6 req-36b8376a-214d-43f5-aad2-2007e77f8683 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:23.905166 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-3c3f2573-43d5-4573-b763-b1fbe4bdc4b6 req-36b8376a-214d-43f5-aad2-2007e77f8683 service nova] Creating event network-vif-plugged:90f6fd17-e1da-4664-af50-c1a16671d7a0 for instance c9973bd5-77cb-4f58-8c30-5d0715218db6 on hv-cinder-84890 Jul 14 12:25:23.910951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-3c3f2573-43d5-4573-b763-b1fbe4bdc4b6 req-36b8376a-214d-43f5-aad2-2007e77f8683 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040764 Jul 14 12:25:23.911570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 480/946] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:25:24.406122 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-61bc524c-d7b3-4bf1-bc58-b28219d42ab9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:24.406737 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-61bc524c-d7b3-4bf1-bc58-b28219d42ab9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:24.413650 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-61bc524c-d7b3-4bf1-bc58-b28219d42ab9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:24.414738 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-61bc524c-d7b3-4bf1-bc58-b28219d42ab9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:24.416418 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-61bc524c-d7b3-4bf1-bc58-b28219d42ab9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:24.416978 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-61bc524c-d7b3-4bf1-bc58-b28219d42ab9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:24.590112 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-61bc524c-d7b3-4bf1-bc58-b28219d42ab9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:24.597731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-61bc524c-d7b3-4bf1-bc58-b28219d42ab9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:24.599267 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-61bc524c-d7b3-4bf1-bc58-b28219d42ab9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:24.600433 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-61bc524c-d7b3-4bf1-bc58-b28219d42ab9 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1743 microversion: 2.20 time: 0.198512 Jul 14 12:25:24.600990 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 467/947] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:24 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1743 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:24.662260 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-82aa1eff-8ed6-462b-a36e-a4264fa4fbe3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:24.671817 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-82aa1eff-8ed6-462b-a36e-a4264fa4fbe3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:24.671817 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-82aa1eff-8ed6-462b-a36e-a4264fa4fbe3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:24.671817 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-82aa1eff-8ed6-462b-a36e-a4264fa4fbe3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:24.671817 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-82aa1eff-8ed6-462b-a36e-a4264fa4fbe3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:24.672226 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-82aa1eff-8ed6-462b-a36e-a4264fa4fbe3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:24.814216 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-82aa1eff-8ed6-462b-a36e-a4264fa4fbe3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:24.815004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-85598b0d-3783-47ef-973a-9fac9b488904 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:24.815706 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-85598b0d-3783-47ef-973a-9fac9b488904 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:24.821987 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-82aa1eff-8ed6-462b-a36e-a4264fa4fbe3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.164676 Jul 14 12:25:24.822567 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 481/948] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:24 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:24.823095 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-85598b0d-3783-47ef-973a-9fac9b488904 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:24.823661 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-85598b0d-3783-47ef-973a-9fac9b488904 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:24.824530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-85598b0d-3783-47ef-973a-9fac9b488904 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:24.825036 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-85598b0d-3783-47ef-973a-9fac9b488904 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:24.899034 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-85598b0d-3783-47ef-973a-9fac9b488904 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:24.906919 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-85598b0d-3783-47ef-973a-9fac9b488904 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1293 microversion: 2.1 time: 0.095918 Jul 14 12:25:24.907483 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 468/949] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:24 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:25:25.621202 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-46830025-bf95-474d-906c-94cd0ed667f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:25.621982 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-46830025-bf95-474d-906c-94cd0ed667f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:25.629288 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-46830025-bf95-474d-906c-94cd0ed667f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:25.630488 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-46830025-bf95-474d-906c-94cd0ed667f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:25.631469 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-46830025-bf95-474d-906c-94cd0ed667f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:25.632671 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-46830025-bf95-474d-906c-94cd0ed667f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:25.787956 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-46830025-bf95-474d-906c-94cd0ed667f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:25.799848 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-46830025-bf95-474d-906c-94cd0ed667f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:25.802306 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-46830025-bf95-474d-906c-94cd0ed667f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:25.803704 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-46830025-bf95-474d-906c-94cd0ed667f4 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1743 microversion: 2.20 time: 0.187508 Jul 14 12:25:25.804478 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 482/950] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:25 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:25.840501 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-99daca1a-7a4b-44de-9265-e797c2732df3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:25.842256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-99daca1a-7a4b-44de-9265-e797c2732df3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:25.853003 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-99daca1a-7a4b-44de-9265-e797c2732df3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:25.853660 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-99daca1a-7a4b-44de-9265-e797c2732df3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:25.854703 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-99daca1a-7a4b-44de-9265-e797c2732df3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:25.855370 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-99daca1a-7a4b-44de-9265-e797c2732df3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:25.925164 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f423fbad-9ac1-4720-9ce4-83c14368847c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:25.925943 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f423fbad-9ac1-4720-9ce4-83c14368847c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:25.932734 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f423fbad-9ac1-4720-9ce4-83c14368847c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:25.934940 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f423fbad-9ac1-4720-9ce4-83c14368847c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:25.934940 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f423fbad-9ac1-4720-9ce4-83c14368847c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:25.934940 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f423fbad-9ac1-4720-9ce4-83c14368847c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:26.007283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-99daca1a-7a4b-44de-9265-e797c2732df3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:26.009135 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f423fbad-9ac1-4720-9ce4-83c14368847c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:26.016709 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-99daca1a-7a4b-44de-9265-e797c2732df3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1266 microversion: 2.1 time: 0.181421 Jul 14 12:25:26.017913 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 469/951] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:25 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:26.019524 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f423fbad-9ac1-4720-9ce4-83c14368847c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1301 microversion: 2.1 time: 0.098170 Jul 14 12:25:26.027977 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 483/952] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:25 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1301 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:25:26.824389 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9f940fcb-d6b8-4b1f-b33f-1a770e88d206 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:26.824996 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9f940fcb-d6b8-4b1f-b33f-1a770e88d206 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:26.831124 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f940fcb-d6b8-4b1f-b33f-1a770e88d206 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:26.831566 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f940fcb-d6b8-4b1f-b33f-1a770e88d206 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:26.832318 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f940fcb-d6b8-4b1f-b33f-1a770e88d206 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:26.832749 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9f940fcb-d6b8-4b1f-b33f-1a770e88d206 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:26.835288 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:27.034462 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e71a0df0-5279-4ae9-8770-82fa465ea00b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:27.035258 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e71a0df0-5279-4ae9-8770-82fa465ea00b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:27.043396 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e71a0df0-5279-4ae9-8770-82fa465ea00b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:27.043899 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e71a0df0-5279-4ae9-8770-82fa465ea00b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:27.044686 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e71a0df0-5279-4ae9-8770-82fa465ea00b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:27.045168 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e71a0df0-5279-4ae9-8770-82fa465ea00b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:27.160491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9f940fcb-d6b8-4b1f-b33f-1a770e88d206 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:27.170722 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9f940fcb-d6b8-4b1f-b33f-1a770e88d206 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:27.172234 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9f940fcb-d6b8-4b1f-b33f-1a770e88d206 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:27.173619 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9f940fcb-d6b8-4b1f-b33f-1a770e88d206 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1743 microversion: 2.20 time: 0.353858 Jul 14 12:25:27.174816 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 470/953] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:26 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1743 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:25:27.180485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-dbe8dcd2-a3fa-4ed4-85f4-cf2028fba186 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:27.181311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-dbe8dcd2-a3fa-4ed4-85f4-cf2028fba186 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:27.188599 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dbe8dcd2-a3fa-4ed4-85f4-cf2028fba186 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:27.189294 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dbe8dcd2-a3fa-4ed4-85f4-cf2028fba186 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:27.190271 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dbe8dcd2-a3fa-4ed4-85f4-cf2028fba186 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:27.190924 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dbe8dcd2-a3fa-4ed4-85f4-cf2028fba186 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:27.197981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e71a0df0-5279-4ae9-8770-82fa465ea00b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:27.201826 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=100 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:27.206385 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e71a0df0-5279-4ae9-8770-82fa465ea00b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1453 microversion: 2.1 time: 0.176003 Jul 14 12:25:27.207491 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 484/954] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:27 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:25:27.227945 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2cc6b01c-5632-4452-90da-e8ce0d13df4e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:27.228876 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2cc6b01c-5632-4452-90da-e8ce0d13df4e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:27.240944 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2cc6b01c-5632-4452-90da-e8ce0d13df4e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:27.242002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2cc6b01c-5632-4452-90da-e8ce0d13df4e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:27.243631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2cc6b01c-5632-4452-90da-e8ce0d13df4e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:27.244765 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2cc6b01c-5632-4452-90da-e8ce0d13df4e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:27.323420 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-dbe8dcd2-a3fa-4ed4-85f4-cf2028fba186 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:27.335113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-dbe8dcd2-a3fa-4ed4-85f4-cf2028fba186 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1299 microversion: 2.1 time: 0.158943 Jul 14 12:25:27.336401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 471/955] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:27 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1299 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:27.397631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2cc6b01c-5632-4452-90da-e8ce0d13df4e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:27.408354 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2cc6b01c-5632-4452-90da-e8ce0d13df4e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1453 microversion: 2.1 time: 0.185348 Jul 14 12:25:27.408354 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 485/956] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:27 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:25:27.844050 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-e6fe6704-74df-44d7-8ddc-b93ca8f04994 req-8e869e79-6be9-4aab-95c8-780691a6929f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a356720e-5371-4d02-bd6d-5293e39ed68a", "name": "network-vif-plugged", "status": "completed", "tag": "3c14bf32-ee21-46df-a087-dc33eef08a69"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:27.861729 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-e6fe6704-74df-44d7-8ddc-b93ca8f04994 req-8e869e79-6be9-4aab-95c8-780691a6929f service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:27.865785 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-e6fe6704-74df-44d7-8ddc-b93ca8f04994 req-8e869e79-6be9-4aab-95c8-780691a6929f service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:27.896232 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-e6fe6704-74df-44d7-8ddc-b93ca8f04994 req-8e869e79-6be9-4aab-95c8-780691a6929f service nova] Creating event network-vif-plugged:3c14bf32-ee21-46df-a087-dc33eef08a69 for instance a356720e-5371-4d02-bd6d-5293e39ed68a on hv-cinder-84890 Jul 14 12:25:27.910576 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-e6fe6704-74df-44d7-8ddc-b93ca8f04994 req-8e869e79-6be9-4aab-95c8-780691a6929f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068648 Jul 14 12:25:27.912032 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 472/957] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:25:28.196000 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-dd0a2ad2-27b5-42c6-8040-bb726fc206de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:28.201269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-dd0a2ad2-27b5-42c6-8040-bb726fc206de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:28.203869 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dd0a2ad2-27b5-42c6-8040-bb726fc206de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:28.206279 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dd0a2ad2-27b5-42c6-8040-bb726fc206de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:28.207287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dd0a2ad2-27b5-42c6-8040-bb726fc206de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:28.207736 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-dd0a2ad2-27b5-42c6-8040-bb726fc206de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:28.361953 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d5e50f98-2ec7-4fb0-9873-eee531a4e1ad tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:28.363424 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d5e50f98-2ec7-4fb0-9873-eee531a4e1ad tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:28.384977 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d5e50f98-2ec7-4fb0-9873-eee531a4e1ad tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:28.385844 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d5e50f98-2ec7-4fb0-9873-eee531a4e1ad tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:28.386982 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d5e50f98-2ec7-4fb0-9873-eee531a4e1ad tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:28.387749 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d5e50f98-2ec7-4fb0-9873-eee531a4e1ad tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:28.427107 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dd0a2ad2-27b5-42c6-8040-bb726fc206de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:28.444501 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dd0a2ad2-27b5-42c6-8040-bb726fc206de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:28.452467 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-dd0a2ad2-27b5-42c6-8040-bb726fc206de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:28.453875 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-dd0a2ad2-27b5-42c6-8040-bb726fc206de tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.264317 Jul 14 12:25:28.454584 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 486/958] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:28 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:28.752857 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d5e50f98-2ec7-4fb0-9873-eee531a4e1ad tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:28.761075 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d5e50f98-2ec7-4fb0-9873-eee531a4e1ad tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.410520 Jul 14 12:25:28.762235 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 473/959] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:28 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:29.473228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ef5ee40e-2537-46f1-8f84-d5890a161002 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:29.473832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ef5ee40e-2537-46f1-8f84-d5890a161002 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:29.490923 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ef5ee40e-2537-46f1-8f84-d5890a161002 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:29.491690 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ef5ee40e-2537-46f1-8f84-d5890a161002 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:29.493455 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ef5ee40e-2537-46f1-8f84-d5890a161002 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:29.494053 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ef5ee40e-2537-46f1-8f84-d5890a161002 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:29.691473 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ef5ee40e-2537-46f1-8f84-d5890a161002 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:29.700884 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ef5ee40e-2537-46f1-8f84-d5890a161002 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:29.702522 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ef5ee40e-2537-46f1-8f84-d5890a161002 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:29.704621 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ef5ee40e-2537-46f1-8f84-d5890a161002 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.234800 Jul 14 12:25:29.706037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 487/960] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:29 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:29.777689 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a7c1cd67-287f-4f74-a4e1-c9179e96441b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:29.778297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a7c1cd67-287f-4f74-a4e1-c9179e96441b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:29.787591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a7c1cd67-287f-4f74-a4e1-c9179e96441b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:29.788578 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a7c1cd67-287f-4f74-a4e1-c9179e96441b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:29.790222 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a7c1cd67-287f-4f74-a4e1-c9179e96441b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:29.791182 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a7c1cd67-287f-4f74-a4e1-c9179e96441b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:29.991203 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-0e6b9fd7-e9a8-4f80-904f-d982bda9f46e req-fcfdcfde-dfab-44ec-b745-399ff68eab2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11f46c7-a881-4c33-a4b7-96933eebcf57", "tag": "44491564-6962-4103-ad53-cbf800a11b21"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:30.011450 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-0e6b9fd7-e9a8-4f80-904f-d982bda9f46e req-fcfdcfde-dfab-44ec-b745-399ff68eab2a service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:30.011979 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-0e6b9fd7-e9a8-4f80-904f-d982bda9f46e req-fcfdcfde-dfab-44ec-b745-399ff68eab2a service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:30.049705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-0e6b9fd7-e9a8-4f80-904f-d982bda9f46e req-fcfdcfde-dfab-44ec-b745-399ff68eab2a service nova] Creating event network-changed:44491564-6962-4103-ad53-cbf800a11b21 for instance b11f46c7-a881-4c33-a4b7-96933eebcf57 on hv-cinder-84890 Jul 14 12:25:30.072884 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-0e6b9fd7-e9a8-4f80-904f-d982bda9f46e req-fcfdcfde-dfab-44ec-b745-399ff68eab2a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075730 Jul 14 12:25:30.077830 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 488/961] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:25:30.469639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a7c1cd67-287f-4f74-a4e1-c9179e96441b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:30.480419 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a7c1cd67-287f-4f74-a4e1-c9179e96441b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.706579 Jul 14 12:25:30.484509 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 474/962] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:29 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:30.735538 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3ef21f7c-4343-4f3b-a1e6-5eddf27b8c21 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:30.736288 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3ef21f7c-4343-4f3b-a1e6-5eddf27b8c21 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:30.755606 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3ef21f7c-4343-4f3b-a1e6-5eddf27b8c21 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:30.756062 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3ef21f7c-4343-4f3b-a1e6-5eddf27b8c21 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:30.757105 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3ef21f7c-4343-4f3b-a1e6-5eddf27b8c21 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:30.774011 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3ef21f7c-4343-4f3b-a1e6-5eddf27b8c21 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:30.923127 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3ef21f7c-4343-4f3b-a1e6-5eddf27b8c21 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:30.948168 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3ef21f7c-4343-4f3b-a1e6-5eddf27b8c21 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:30.949975 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3ef21f7c-4343-4f3b-a1e6-5eddf27b8c21 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:30.956189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3ef21f7c-4343-4f3b-a1e6-5eddf27b8c21 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.232147 Jul 14 12:25:30.963249 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 489/963] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:30 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:31.500951 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8c13e3b7-cde5-4b28-a68f-901bd86c6406 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:31.503228 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8c13e3b7-cde5-4b28-a68f-901bd86c6406 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:31.514995 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c13e3b7-cde5-4b28-a68f-901bd86c6406 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:31.515452 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c13e3b7-cde5-4b28-a68f-901bd86c6406 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:31.516244 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c13e3b7-cde5-4b28-a68f-901bd86c6406 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:31.516684 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8c13e3b7-cde5-4b28-a68f-901bd86c6406 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:31.879811 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8c13e3b7-cde5-4b28-a68f-901bd86c6406 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:31.890400 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8c13e3b7-cde5-4b28-a68f-901bd86c6406 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.394056 Jul 14 12:25:31.891197 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 475/964] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:31 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:31.970519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e319edf8-bea7-431c-9a9b-ff20460910d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:31.971160 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e319edf8-bea7-431c-9a9b-ff20460910d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:31.978077 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e319edf8-bea7-431c-9a9b-ff20460910d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:31.978533 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e319edf8-bea7-431c-9a9b-ff20460910d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:31.979340 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e319edf8-bea7-431c-9a9b-ff20460910d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:31.979806 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e319edf8-bea7-431c-9a9b-ff20460910d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:32.158165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e319edf8-bea7-431c-9a9b-ff20460910d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:32.171266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e319edf8-bea7-431c-9a9b-ff20460910d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:32.174021 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e319edf8-bea7-431c-9a9b-ff20460910d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:32.176517 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e319edf8-bea7-431c-9a9b-ff20460910d0 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.208964 Jul 14 12:25:32.188753 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 490/965] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:31 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:32.384397 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-90d2f89d-aec2-4f2c-97bb-4a1544e66c2d req-1965d32f-6b21-4f3f-9c26-2657d6d9a063 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9973bd5-77cb-4f58-8c30-5d0715218db6", "tag": "90f6fd17-e1da-4664-af50-c1a16671d7a0"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:32.400045 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-90d2f89d-aec2-4f2c-97bb-4a1544e66c2d req-1965d32f-6b21-4f3f-9c26-2657d6d9a063 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:32.400879 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-90d2f89d-aec2-4f2c-97bb-4a1544e66c2d req-1965d32f-6b21-4f3f-9c26-2657d6d9a063 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:32.423656 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-90d2f89d-aec2-4f2c-97bb-4a1544e66c2d req-1965d32f-6b21-4f3f-9c26-2657d6d9a063 service nova] Creating event network-changed:90f6fd17-e1da-4664-af50-c1a16671d7a0 for instance c9973bd5-77cb-4f58-8c30-5d0715218db6 on hv-cinder-84890 Jul 14 12:25:32.454522 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-90d2f89d-aec2-4f2c-97bb-4a1544e66c2d req-1965d32f-6b21-4f3f-9c26-2657d6d9a063 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071697 Jul 14 12:25:32.455737 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 476/966] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:25:32.908804 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-be1bd9eb-6902-4e18-be9c-138539f62c2e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:32.909685 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-be1bd9eb-6902-4e18-be9c-138539f62c2e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:32.911930 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=6 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:32.918390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-be1bd9eb-6902-4e18-be9c-138539f62c2e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:32.918870 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-be1bd9eb-6902-4e18-be9c-138539f62c2e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:32.919884 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-be1bd9eb-6902-4e18-be9c-138539f62c2e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:32.920476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-be1bd9eb-6902-4e18-be9c-138539f62c2e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:33.122890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-be1bd9eb-6902-4e18-be9c-138539f62c2e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:33.137360 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-be1bd9eb-6902-4e18-be9c-138539f62c2e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.230699 Jul 14 12:25:33.139043 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 491/967] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:32 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:33.192357 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:33.193442 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=6 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:33.199294 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8ba7a371-94c6-4808-b07e-040f5e0cb165 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:33.200408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8ba7a371-94c6-4808-b07e-040f5e0cb165 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:33.207257 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8ba7a371-94c6-4808-b07e-040f5e0cb165 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:33.208048 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8ba7a371-94c6-4808-b07e-040f5e0cb165 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:33.209161 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8ba7a371-94c6-4808-b07e-040f5e0cb165 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:33.209810 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8ba7a371-94c6-4808-b07e-040f5e0cb165 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:33.540072 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8ba7a371-94c6-4808-b07e-040f5e0cb165 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:33.551916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8ba7a371-94c6-4808-b07e-040f5e0cb165 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:33.557535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8ba7a371-94c6-4808-b07e-040f5e0cb165 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:33.557535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8ba7a371-94c6-4808-b07e-040f5e0cb165 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.363992 Jul 14 12:25:33.557535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 477/968] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:33 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:25:34.156126 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-bdc4e4b4-34c5-49a0-a3e8-7853c959d9f8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:34.156927 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-bdc4e4b4-34c5-49a0-a3e8-7853c959d9f8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:34.163953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bdc4e4b4-34c5-49a0-a3e8-7853c959d9f8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:34.164556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bdc4e4b4-34c5-49a0-a3e8-7853c959d9f8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:34.165586 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bdc4e4b4-34c5-49a0-a3e8-7853c959d9f8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:34.166267 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bdc4e4b4-34c5-49a0-a3e8-7853c959d9f8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:34.308054 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-bdc4e4b4-34c5-49a0-a3e8-7853c959d9f8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:34.316427 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-bdc4e4b4-34c5-49a0-a3e8-7853c959d9f8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.165284 Jul 14 12:25:34.317008 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 492/969] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:34 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:34.574436 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-98bbdc57-cbff-416d-9f0e-6aaa9c2a153a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:34.575028 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-98bbdc57-cbff-416d-9f0e-6aaa9c2a153a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:34.581602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-98bbdc57-cbff-416d-9f0e-6aaa9c2a153a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:34.582250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-98bbdc57-cbff-416d-9f0e-6aaa9c2a153a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:34.583213 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-98bbdc57-cbff-416d-9f0e-6aaa9c2a153a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:34.583646 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-98bbdc57-cbff-416d-9f0e-6aaa9c2a153a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:34.732572 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-98bbdc57-cbff-416d-9f0e-6aaa9c2a153a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:34.741061 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-98bbdc57-cbff-416d-9f0e-6aaa9c2a153a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:34.743408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-98bbdc57-cbff-416d-9f0e-6aaa9c2a153a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:34.744855 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-98bbdc57-cbff-416d-9f0e-6aaa9c2a153a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.175121 Jul 14 12:25:34.745513 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 478/970] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:34 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:35.333415 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a9a3f8e9-89d8-437c-832f-a27743cfc62f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:35.333973 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a9a3f8e9-89d8-437c-832f-a27743cfc62f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:35.340774 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a9a3f8e9-89d8-437c-832f-a27743cfc62f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:35.341231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a9a3f8e9-89d8-437c-832f-a27743cfc62f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:35.342004 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a9a3f8e9-89d8-437c-832f-a27743cfc62f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:35.342446 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a9a3f8e9-89d8-437c-832f-a27743cfc62f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:35.490174 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a9a3f8e9-89d8-437c-832f-a27743cfc62f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:35.498554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a9a3f8e9-89d8-437c-832f-a27743cfc62f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.169052 Jul 14 12:25:35.499417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 493/971] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:35 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:35.764248 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b146c77a-e54f-41a6-9701-e0adfaf9648e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:35.764950 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b146c77a-e54f-41a6-9701-e0adfaf9648e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:35.774175 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b146c77a-e54f-41a6-9701-e0adfaf9648e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:35.774613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b146c77a-e54f-41a6-9701-e0adfaf9648e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:35.775419 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b146c77a-e54f-41a6-9701-e0adfaf9648e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:35.775841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b146c77a-e54f-41a6-9701-e0adfaf9648e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:35.924297 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b146c77a-e54f-41a6-9701-e0adfaf9648e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:35.934897 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b146c77a-e54f-41a6-9701-e0adfaf9648e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:35.936420 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b146c77a-e54f-41a6-9701-e0adfaf9648e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:35.937578 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b146c77a-e54f-41a6-9701-e0adfaf9648e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.177701 Jul 14 12:25:35.950839 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 479/972] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:35 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:36.516332 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cb9cfe37-3afc-40b1-af43-dcc7554eb06f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:36.517106 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-cb9cfe37-3afc-40b1-af43-dcc7554eb06f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:36.526514 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb9cfe37-3afc-40b1-af43-dcc7554eb06f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:36.527332 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb9cfe37-3afc-40b1-af43-dcc7554eb06f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:36.528209 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb9cfe37-3afc-40b1-af43-dcc7554eb06f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:36.528721 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb9cfe37-3afc-40b1-af43-dcc7554eb06f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:36.686144 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-cb9cfe37-3afc-40b1-af43-dcc7554eb06f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:36.695200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cb9cfe37-3afc-40b1-af43-dcc7554eb06f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.182105 Jul 14 12:25:36.706933 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 494/973] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:36 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:36.957413 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-67ff42d1-df62-4cac-812f-51b4a04cab70 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:36.958022 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-67ff42d1-df62-4cac-812f-51b4a04cab70 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:36.965110 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-67ff42d1-df62-4cac-812f-51b4a04cab70 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:36.965562 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-67ff42d1-df62-4cac-812f-51b4a04cab70 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:36.968098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-67ff42d1-df62-4cac-812f-51b4a04cab70 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:36.968098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-67ff42d1-df62-4cac-812f-51b4a04cab70 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:37.109959 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-67ff42d1-df62-4cac-812f-51b4a04cab70 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:37.119479 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-67ff42d1-df62-4cac-812f-51b4a04cab70 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:37.121100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-67ff42d1-df62-4cac-812f-51b4a04cab70 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:37.122331 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-67ff42d1-df62-4cac-812f-51b4a04cab70 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.168823 Jul 14 12:25:37.123248 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 480/974] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:36 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:37.714444 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-19a7f5f3-ca3d-4368-80ef-d82f385335a5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:37.715722 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-19a7f5f3-ca3d-4368-80ef-d82f385335a5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:37.732789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-19a7f5f3-ca3d-4368-80ef-d82f385335a5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:37.733528 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-19a7f5f3-ca3d-4368-80ef-d82f385335a5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:37.734614 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-19a7f5f3-ca3d-4368-80ef-d82f385335a5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:37.735226 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-19a7f5f3-ca3d-4368-80ef-d82f385335a5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:37.898272 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-19a7f5f3-ca3d-4368-80ef-d82f385335a5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:37.908134 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-19a7f5f3-ca3d-4368-80ef-d82f385335a5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.198081 Jul 14 12:25:37.909496 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 495/975] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:37 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:38.141660 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f2709755-547b-49b3-bc3b-8155746a6a41 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:38.142236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f2709755-547b-49b3-bc3b-8155746a6a41 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:38.149825 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f2709755-547b-49b3-bc3b-8155746a6a41 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:38.430243 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f2709755-547b-49b3-bc3b-8155746a6a41 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:38.430243 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f2709755-547b-49b3-bc3b-8155746a6a41 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:38.430243 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f2709755-547b-49b3-bc3b-8155746a6a41 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:38.431244 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f2709755-547b-49b3-bc3b-8155746a6a41 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:38.431244 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f2709755-547b-49b3-bc3b-8155746a6a41 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:38.431565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f2709755-547b-49b3-bc3b-8155746a6a41 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:38.431565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f2709755-547b-49b3-bc3b-8155746a6a41 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.164639 Jul 14 12:25:38.431565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 481/976] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:38 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:38.881231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-b04020a5-b87e-4742-b03a-b526a5c2eee2 req-e16bd9c5-afce-4398-8cb0-936546767dff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11f46c7-a881-4c33-a4b7-96933eebcf57", "name": "network-vif-plugged", "status": "completed", "tag": "44491564-6962-4103-ad53-cbf800a11b21"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:38.893548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-b04020a5-b87e-4742-b03a-b526a5c2eee2 req-e16bd9c5-afce-4398-8cb0-936546767dff service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:38.893998 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-b04020a5-b87e-4742-b03a-b526a5c2eee2 req-e16bd9c5-afce-4398-8cb0-936546767dff service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:38.906569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-b04020a5-b87e-4742-b03a-b526a5c2eee2 req-e16bd9c5-afce-4398-8cb0-936546767dff service nova] Creating event network-vif-plugged:44491564-6962-4103-ad53-cbf800a11b21 for instance b11f46c7-a881-4c33-a4b7-96933eebcf57 on hv-cinder-84890 Jul 14 12:25:38.911724 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-b04020a5-b87e-4742-b03a-b526a5c2eee2 req-e16bd9c5-afce-4398-8cb0-936546767dff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034489 Jul 14 12:25:38.912799 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 496/977] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:25:38.926473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c3791552-9ef2-43d2-817b-1dfc6b33fea6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:38.927393 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c3791552-9ef2-43d2-817b-1dfc6b33fea6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:38.935059 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3791552-9ef2-43d2-817b-1dfc6b33fea6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:38.935611 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3791552-9ef2-43d2-817b-1dfc6b33fea6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:38.936437 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3791552-9ef2-43d2-817b-1dfc6b33fea6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:38.936943 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c3791552-9ef2-43d2-817b-1dfc6b33fea6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:39.119352 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c3791552-9ef2-43d2-817b-1dfc6b33fea6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:39.128623 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c3791552-9ef2-43d2-817b-1dfc6b33fea6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.206354 Jul 14 12:25:39.129563 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 482/978] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:38 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:39.323032 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-055885b8-31b5-4664-adff-893b86124a1b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:39.324098 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-055885b8-31b5-4664-adff-893b86124a1b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:39.330950 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-055885b8-31b5-4664-adff-893b86124a1b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:39.331412 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-055885b8-31b5-4664-adff-893b86124a1b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:39.332200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-055885b8-31b5-4664-adff-893b86124a1b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:39.332641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-055885b8-31b5-4664-adff-893b86124a1b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:39.471708 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-055885b8-31b5-4664-adff-893b86124a1b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:39.480543 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-055885b8-31b5-4664-adff-893b86124a1b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:39.482073 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-055885b8-31b5-4664-adff-893b86124a1b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:39.483261 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-055885b8-31b5-4664-adff-893b86124a1b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.165642 Jul 14 12:25:39.497969 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 497/979] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:39 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:40.150081 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ef1ffa08-64e4-46ff-a877-c29911379239 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:40.150690 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ef1ffa08-64e4-46ff-a877-c29911379239 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:40.157259 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ef1ffa08-64e4-46ff-a877-c29911379239 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:40.157701 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ef1ffa08-64e4-46ff-a877-c29911379239 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:40.158457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ef1ffa08-64e4-46ff-a877-c29911379239 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:40.158913 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ef1ffa08-64e4-46ff-a877-c29911379239 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:40.290875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ef1ffa08-64e4-46ff-a877-c29911379239 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:40.298564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ef1ffa08-64e4-46ff-a877-c29911379239 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.152824 Jul 14 12:25:40.299158 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 483/980] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:40 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:25:40.501344 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-133a395b-e8d4-42b2-9aa8-f83303389da3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:40.501963 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-133a395b-e8d4-42b2-9aa8-f83303389da3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:40.509165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-133a395b-e8d4-42b2-9aa8-f83303389da3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:40.509616 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-133a395b-e8d4-42b2-9aa8-f83303389da3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:40.510403 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-133a395b-e8d4-42b2-9aa8-f83303389da3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:40.510859 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-133a395b-e8d4-42b2-9aa8-f83303389da3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:40.640821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-133a395b-e8d4-42b2-9aa8-f83303389da3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:40.648843 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-133a395b-e8d4-42b2-9aa8-f83303389da3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:40.650371 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-133a395b-e8d4-42b2-9aa8-f83303389da3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:40.651560 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-133a395b-e8d4-42b2-9aa8-f83303389da3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.154155 Jul 14 12:25:40.652122 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 498/981] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:40 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:41.315102 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8f9aec94-9da3-416f-a3c2-58e668c212af tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:41.315717 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8f9aec94-9da3-416f-a3c2-58e668c212af tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:41.322624 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8f9aec94-9da3-416f-a3c2-58e668c212af tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:41.323105 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8f9aec94-9da3-416f-a3c2-58e668c212af tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:41.323871 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8f9aec94-9da3-416f-a3c2-58e668c212af tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:41.324308 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8f9aec94-9da3-416f-a3c2-58e668c212af tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:41.450434 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8f9aec94-9da3-416f-a3c2-58e668c212af tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:41.457802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8f9aec94-9da3-416f-a3c2-58e668c212af tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.146618 Jul 14 12:25:41.458363 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 484/982] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:41 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:41.669838 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ff5294f3-cda2-4757-b939-329325875811 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:41.670483 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ff5294f3-cda2-4757-b939-329325875811 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:41.677048 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ff5294f3-cda2-4757-b939-329325875811 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:41.677508 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ff5294f3-cda2-4757-b939-329325875811 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:41.678272 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ff5294f3-cda2-4757-b939-329325875811 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:41.678716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ff5294f3-cda2-4757-b939-329325875811 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:41.806880 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ff5294f3-cda2-4757-b939-329325875811 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:41.814753 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ff5294f3-cda2-4757-b939-329325875811 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:41.816289 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ff5294f3-cda2-4757-b939-329325875811 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:41.817604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ff5294f3-cda2-4757-b939-329325875811 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1738 microversion: 2.20 time: 0.151890 Jul 14 12:25:41.818313 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 499/983] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:41 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:42.475432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e5d24371-0d76-490b-824f-c03d90b57bf5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:42.475960 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e5d24371-0d76-490b-824f-c03d90b57bf5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:42.483518 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e5d24371-0d76-490b-824f-c03d90b57bf5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:42.483970 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e5d24371-0d76-490b-824f-c03d90b57bf5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:42.484741 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e5d24371-0d76-490b-824f-c03d90b57bf5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:42.485183 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e5d24371-0d76-490b-824f-c03d90b57bf5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:42.614162 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e5d24371-0d76-490b-824f-c03d90b57bf5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:42.621593 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e5d24371-0d76-490b-824f-c03d90b57bf5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1366 microversion: 2.1 time: 0.150104 Jul 14 12:25:42.622154 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 485/984] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:42 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:42.836819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-35832d59-a796-49de-81e5-25f3ce79f5fa tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:42.837426 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-35832d59-a796-49de-81e5-25f3ce79f5fa tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:42.843909 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-35832d59-a796-49de-81e5-25f3ce79f5fa tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:42.849697 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-35832d59-a796-49de-81e5-25f3ce79f5fa tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:42.849697 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-35832d59-a796-49de-81e5-25f3ce79f5fa tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:42.849697 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-35832d59-a796-49de-81e5-25f3ce79f5fa tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:42.974137 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-35832d59-a796-49de-81e5-25f3ce79f5fa tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:42.985555 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-35832d59-a796-49de-81e5-25f3ce79f5fa tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:42.985555 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-35832d59-a796-49de-81e5-25f3ce79f5fa tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:42.985555 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-35832d59-a796-49de-81e5-25f3ce79f5fa tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1720 microversion: 2.20 time: 0.152510 Jul 14 12:25:42.985920 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 500/985] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:42 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:43.638871 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-928cd5a9-24ad-4677-864f-aaf9e470d171 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:43.639427 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-928cd5a9-24ad-4677-864f-aaf9e470d171 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:43.646015 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-928cd5a9-24ad-4677-864f-aaf9e470d171 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:43.646461 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-928cd5a9-24ad-4677-864f-aaf9e470d171 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:43.647236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-928cd5a9-24ad-4677-864f-aaf9e470d171 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:43.647671 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-928cd5a9-24ad-4677-864f-aaf9e470d171 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:43.776036 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-928cd5a9-24ad-4677-864f-aaf9e470d171 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:43.783731 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-928cd5a9-24ad-4677-864f-aaf9e470d171 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1556 microversion: 2.1 time: 0.148827 Jul 14 12:25:43.784349 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 486/986] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:43 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:43.800540 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-887b32e6-12b8-4e23-a12d-350f606cf667 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:43.801028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-887b32e6-12b8-4e23-a12d-350f606cf667 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:43.808420 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-887b32e6-12b8-4e23-a12d-350f606cf667 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:43.808860 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-887b32e6-12b8-4e23-a12d-350f606cf667 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:43.809618 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-887b32e6-12b8-4e23-a12d-350f606cf667 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:43.810048 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-887b32e6-12b8-4e23-a12d-350f606cf667 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:43.893082 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-887b32e6-12b8-4e23-a12d-350f606cf667 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096365 Jul 14 12:25:43.894105 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 501/987] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 12:25:43 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:25:44.002905 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a947eb93-3fc1-41f5-aabf-74baa2ab2777 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:44.007277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a947eb93-3fc1-41f5-aabf-74baa2ab2777 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:44.010355 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a947eb93-3fc1-41f5-aabf-74baa2ab2777 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:44.011059 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a947eb93-3fc1-41f5-aabf-74baa2ab2777 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:44.011836 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a947eb93-3fc1-41f5-aabf-74baa2ab2777 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:44.012272 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a947eb93-3fc1-41f5-aabf-74baa2ab2777 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:44.229288 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a947eb93-3fc1-41f5-aabf-74baa2ab2777 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:44.240044 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a947eb93-3fc1-41f5-aabf-74baa2ab2777 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:44.242347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a947eb93-3fc1-41f5-aabf-74baa2ab2777 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:44.243835 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a947eb93-3fc1-41f5-aabf-74baa2ab2777 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1720 microversion: 2.20 time: 0.244925 Jul 14 12:25:44.258868 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 487/988] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:43 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1720 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:44.909965 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-63dac447-b195-4f6d-89d3-7e5e68d46442 req-6443fa00-0a99-4fee-b85b-c9fe93f0db2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b11f46c7-a881-4c33-a4b7-96933eebcf57", "tag": "44491564-6962-4103-ad53-cbf800a11b21"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:44.918632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-63dac447-b195-4f6d-89d3-7e5e68d46442 req-6443fa00-0a99-4fee-b85b-c9fe93f0db2c service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:44.919133 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-63dac447-b195-4f6d-89d3-7e5e68d46442 req-6443fa00-0a99-4fee-b85b-c9fe93f0db2c service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:44.938889 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-63dac447-b195-4f6d-89d3-7e5e68d46442 req-6443fa00-0a99-4fee-b85b-c9fe93f0db2c service nova] Creating event network-changed:44491564-6962-4103-ad53-cbf800a11b21 for instance b11f46c7-a881-4c33-a4b7-96933eebcf57 on hv-cinder-84890 Jul 14 12:25:44.944433 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-63dac447-b195-4f6d-89d3-7e5e68d46442 req-6443fa00-0a99-4fee-b85b-c9fe93f0db2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038472 Jul 14 12:25:44.946254 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 502/989] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:25:45.263711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ab169a62-3b4a-4550-a280-ce7cde70b7ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:45.264577 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ab169a62-3b4a-4550-a280-ce7cde70b7ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:45.271757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ab169a62-3b4a-4550-a280-ce7cde70b7ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:45.272203 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ab169a62-3b4a-4550-a280-ce7cde70b7ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:45.273738 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ab169a62-3b4a-4550-a280-ce7cde70b7ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:45.274354 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ab169a62-3b4a-4550-a280-ce7cde70b7ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:45.279595 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:45.641951 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ab169a62-3b4a-4550-a280-ce7cde70b7ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:45.650254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ab169a62-3b4a-4550-a280-ce7cde70b7ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:45.651936 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ab169a62-3b4a-4550-a280-ce7cde70b7ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:45.653201 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ab169a62-3b4a-4550-a280-ce7cde70b7ed tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1720 microversion: 2.20 time: 0.393561 Jul 14 12:25:45.653870 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 488/990] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:45 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1720 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:45.829424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e1db3433-c170-4153-a68d-deee5b22af7c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:45.830236 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e1db3433-c170-4153-a68d-deee5b22af7c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:45.832759 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-ba83db28-5336-42ae-bfc1-a5ac6a02a1f9 req-8054fb7a-8f3d-4204-81ef-8c656c54f005 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "905d8954-a633-4e05-a5eb-1bd833799fea", "tag": "97573f11-1cde-45f1-8103-8f5b45ac6f97"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:45.837387 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e1db3433-c170-4153-a68d-deee5b22af7c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:45.837953 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e1db3433-c170-4153-a68d-deee5b22af7c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:45.839504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e1db3433-c170-4153-a68d-deee5b22af7c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:45.842044 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-ba83db28-5336-42ae-bfc1-a5ac6a02a1f9 req-8054fb7a-8f3d-4204-81ef-8c656c54f005 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:45.842700 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e1db3433-c170-4153-a68d-deee5b22af7c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:45.842888 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-ba83db28-5336-42ae-bfc1-a5ac6a02a1f9 req-8054fb7a-8f3d-4204-81ef-8c656c54f005 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:45.855535 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-ba83db28-5336-42ae-bfc1-a5ac6a02a1f9 req-8054fb7a-8f3d-4204-81ef-8c656c54f005 service nova] Creating event network-changed:97573f11-1cde-45f1-8103-8f5b45ac6f97 for instance 905d8954-a633-4e05-a5eb-1bd833799fea on hv-cinder-84890 Jul 14 12:25:45.860523 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-ba83db28-5336-42ae-bfc1-a5ac6a02a1f9 req-8054fb7a-8f3d-4204-81ef-8c656c54f005 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035043 Jul 14 12:25:45.861114 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 489/991] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:25:45.873133 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e1db3433-c170-4153-a68d-deee5b22af7c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:25:45.876287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=100 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:46.144719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e1db3433-c170-4153-a68d-deee5b22af7c tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "DELETE /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 204 len: 0 microversion: 2.1 time: 0.320982 Jul 14 12:25:46.145450 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 503/992] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:25:45 2022] DELETE /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:25:46.154080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c54e8d25-b392-4ce6-aa6f-9a5d4b4c3bbd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:46.154888 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c54e8d25-b392-4ce6-aa6f-9a5d4b4c3bbd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:46.163393 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c54e8d25-b392-4ce6-aa6f-9a5d4b4c3bbd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:46.163393 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c54e8d25-b392-4ce6-aa6f-9a5d4b4c3bbd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:46.164186 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c54e8d25-b392-4ce6-aa6f-9a5d4b4c3bbd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:46.164705 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c54e8d25-b392-4ce6-aa6f-9a5d4b4c3bbd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:46.312435 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c54e8d25-b392-4ce6-aa6f-9a5d4b4c3bbd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:46.320532 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c54e8d25-b392-4ce6-aa6f-9a5d4b4c3bbd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.170025 Jul 14 12:25:46.321532 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 490/993] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:46 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:46.671996 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4df826db-d56d-452b-bc5f-8d832b592bfc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:46.672698 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4df826db-d56d-452b-bc5f-8d832b592bfc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:46.678754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4df826db-d56d-452b-bc5f-8d832b592bfc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:46.679269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4df826db-d56d-452b-bc5f-8d832b592bfc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:46.680195 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4df826db-d56d-452b-bc5f-8d832b592bfc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:46.680637 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4df826db-d56d-452b-bc5f-8d832b592bfc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:47.043360 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4df826db-d56d-452b-bc5f-8d832b592bfc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:47.051156 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4df826db-d56d-452b-bc5f-8d832b592bfc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:47.052646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4df826db-d56d-452b-bc5f-8d832b592bfc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:47.053785 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4df826db-d56d-452b-bc5f-8d832b592bfc tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1720 microversion: 2.20 time: 0.386365 Jul 14 12:25:47.054404 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 504/994] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:46 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1720 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:47.339582 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4d198393-61b5-4000-9032-10e012c788c8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:47.340193 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4d198393-61b5-4000-9032-10e012c788c8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:47.346435 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4d198393-61b5-4000-9032-10e012c788c8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:47.346910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4d198393-61b5-4000-9032-10e012c788c8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:47.347670 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4d198393-61b5-4000-9032-10e012c788c8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:47.348105 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4d198393-61b5-4000-9032-10e012c788c8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:47.474787 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4d198393-61b5-4000-9032-10e012c788c8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:47.482302 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4d198393-61b5-4000-9032-10e012c788c8 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.147319 Jul 14 12:25:47.482881 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 491/995] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:47 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:48.071808 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0c2b9133-5b6f-4356-b791-f28c0a5f75b5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:48.072428 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0c2b9133-5b6f-4356-b791-f28c0a5f75b5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:48.079495 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0c2b9133-5b6f-4356-b791-f28c0a5f75b5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:48.079943 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0c2b9133-5b6f-4356-b791-f28c0a5f75b5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:48.080709 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0c2b9133-5b6f-4356-b791-f28c0a5f75b5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:48.081142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0c2b9133-5b6f-4356-b791-f28c0a5f75b5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:48.205578 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-5388ed26-ae60-444a-b6d3-4f60b473efbb req-259b0783-20a6-4f5f-a678-da10e1ef28ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a356720e-5371-4d02-bd6d-5293e39ed68a", "name": "network-vif-unplugged", "status": "completed", "tag": "3c14bf32-ee21-46df-a087-dc33eef08a69"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:48.218334 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-5388ed26-ae60-444a-b6d3-4f60b473efbb req-259b0783-20a6-4f5f-a678-da10e1ef28ce service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:48.218334 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-5388ed26-ae60-444a-b6d3-4f60b473efbb req-259b0783-20a6-4f5f-a678-da10e1ef28ce service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:48.218716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0c2b9133-5b6f-4356-b791-f28c0a5f75b5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:48.227691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0c2b9133-5b6f-4356-b791-f28c0a5f75b5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:48.228915 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-5388ed26-ae60-444a-b6d3-4f60b473efbb req-259b0783-20a6-4f5f-a678-da10e1ef28ce service nova] Creating event network-vif-unplugged:3c14bf32-ee21-46df-a087-dc33eef08a69 for instance a356720e-5371-4d02-bd6d-5293e39ed68a on hv-cinder-84890 Jul 14 12:25:48.234471 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-0c2b9133-5b6f-4356-b791-f28c0a5f75b5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:48.235763 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0c2b9133-5b6f-4356-b791-f28c0a5f75b5 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1720 microversion: 2.20 time: 0.168125 Jul 14 12:25:48.236419 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 505/996] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:48 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:48.238354 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-5388ed26-ae60-444a-b6d3-4f60b473efbb req-259b0783-20a6-4f5f-a678-da10e1ef28ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036795 Jul 14 12:25:48.239183 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 492/997] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:25:48.498834 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-36ed8c40-8e75-4656-b4f4-a43830828be1 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:48.499363 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-36ed8c40-8e75-4656-b4f4-a43830828be1 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:48.505420 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36ed8c40-8e75-4656-b4f4-a43830828be1 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:48.509747 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36ed8c40-8e75-4656-b4f4-a43830828be1 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:48.509747 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36ed8c40-8e75-4656-b4f4-a43830828be1 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:48.509747 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36ed8c40-8e75-4656-b4f4-a43830828be1 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:48.639090 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-36ed8c40-8e75-4656-b4f4-a43830828be1 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:48.646492 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-36ed8c40-8e75-4656-b4f4-a43830828be1 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.151722 Jul 14 12:25:48.647104 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 506/998] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:48 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:49.254318 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7ddba58e-5313-4958-8aef-84293f6cea68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:49.255091 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7ddba58e-5313-4958-8aef-84293f6cea68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:49.261589 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ddba58e-5313-4958-8aef-84293f6cea68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:49.262037 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ddba58e-5313-4958-8aef-84293f6cea68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:49.262817 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ddba58e-5313-4958-8aef-84293f6cea68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:49.263259 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7ddba58e-5313-4958-8aef-84293f6cea68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:49.395776 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7ddba58e-5313-4958-8aef-84293f6cea68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:49.404385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7ddba58e-5313-4958-8aef-84293f6cea68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:49.405902 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7ddba58e-5313-4958-8aef-84293f6cea68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:49.407113 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7ddba58e-5313-4958-8aef-84293f6cea68 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1720 microversion: 2.20 time: 0.157548 Jul 14 12:25:49.407669 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 493/999] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:49 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:49.663993 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-13e5c290-6257-4f24-8f2c-c1ccdee48377 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:49.664663 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-13e5c290-6257-4f24-8f2c-c1ccdee48377 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:49.671336 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-13e5c290-6257-4f24-8f2c-c1ccdee48377 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:49.671787 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-13e5c290-6257-4f24-8f2c-c1ccdee48377 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:49.672556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-13e5c290-6257-4f24-8f2c-c1ccdee48377 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:49.672994 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-13e5c290-6257-4f24-8f2c-c1ccdee48377 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:49.811506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-13e5c290-6257-4f24-8f2c-c1ccdee48377 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:49.819072 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-13e5c290-6257-4f24-8f2c-c1ccdee48377 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.159137 Jul 14 12:25:49.820540 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 507/1000] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:49 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:50.433429 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9ffbe845-6428-4c8d-9790-691f61710d2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:50.434252 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9ffbe845-6428-4c8d-9790-691f61710d2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:50.437168 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:50.443607 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9ffbe845-6428-4c8d-9790-691f61710d2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:50.449238 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9ffbe845-6428-4c8d-9790-691f61710d2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:50.449238 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9ffbe845-6428-4c8d-9790-691f61710d2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:50.449238 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9ffbe845-6428-4c8d-9790-691f61710d2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:50.594116 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9ffbe845-6428-4c8d-9790-691f61710d2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:50.602173 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9ffbe845-6428-4c8d-9790-691f61710d2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:50.603685 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9ffbe845-6428-4c8d-9790-691f61710d2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:50.604878 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9ffbe845-6428-4c8d-9790-691f61710d2d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1723 microversion: 2.20 time: 0.175729 Jul 14 12:25:50.605445 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 494/1001] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:50 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:50.622279 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-bfba31b4-3fb7-43d0-85a1-10999b0d04c6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "607fccc7-5e12-46c6-8ab9-1a6f890c0c00"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:50.623475 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-bfba31b4-3fb7-43d0-85a1-10999b0d04c6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:50.629449 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bfba31b4-3fb7-43d0-85a1-10999b0d04c6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:50.629890 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bfba31b4-3fb7-43d0-85a1-10999b0d04c6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:50.630645 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bfba31b4-3fb7-43d0-85a1-10999b0d04c6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:50.631112 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bfba31b4-3fb7-43d0-85a1-10999b0d04c6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:50.838079 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f3e1f86e-1482-4c83-8436-73db55656d5a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:50.838804 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f3e1f86e-1482-4c83-8436-73db55656d5a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:50.847656 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f3e1f86e-1482-4c83-8436-73db55656d5a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:50.848185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f3e1f86e-1482-4c83-8436-73db55656d5a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:50.849422 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f3e1f86e-1482-4c83-8436-73db55656d5a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:50.849887 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f3e1f86e-1482-4c83-8436-73db55656d5a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:51.308661 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f3e1f86e-1482-4c83-8436-73db55656d5a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:51.316068 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f3e1f86e-1482-4c83-8436-73db55656d5a tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1564 microversion: 2.1 time: 0.482841 Jul 14 12:25:51.316632 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 495/1002] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:50 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1564 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:51.715368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-0ef976d4-8ee9-4e0c-aeb5-06f6177df1e6 req-cc32b6c4-468b-4465-9c4d-c44edaa46360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "905d8954-a633-4e05-a5eb-1bd833799fea", "name": "network-vif-deleted", "tag": "97573f11-1cde-45f1-8103-8f5b45ac6f97"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:51.723987 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-0ef976d4-8ee9-4e0c-aeb5-06f6177df1e6 req-cc32b6c4-468b-4465-9c4d-c44edaa46360 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:51.724429 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-0ef976d4-8ee9-4e0c-aeb5-06f6177df1e6 req-cc32b6c4-468b-4465-9c4d-c44edaa46360 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:51.736137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-0ef976d4-8ee9-4e0c-aeb5-06f6177df1e6 req-cc32b6c4-468b-4465-9c4d-c44edaa46360 service nova] Creating event network-vif-deleted:97573f11-1cde-45f1-8103-8f5b45ac6f97 for instance 905d8954-a633-4e05-a5eb-1bd833799fea on hv-cinder-84890 Jul 14 12:25:51.740929 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-0ef976d4-8ee9-4e0c-aeb5-06f6177df1e6 req-cc32b6c4-468b-4465-9c4d-c44edaa46360 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029247 Jul 14 12:25:51.742284 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 496/1003] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:25:51.789972 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-bfba31b4-3fb7-43d0-85a1-10999b0d04c6 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "POST /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.171700 Jul 14 12:25:51.790628 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 508/1004] 10.222.0.27 () {62 vars in 1363 bytes} [Thu Jul 14 12:25:50 2022] POST /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/os-volume_attachments => generated 188 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 12:25:51.910357 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3a6b69e7-222c-45b1-9d9c-6e2651f5713c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:51.910975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3a6b69e7-222c-45b1-9d9c-6e2651f5713c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:51.917365 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3a6b69e7-222c-45b1-9d9c-6e2651f5713c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:51.918063 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3a6b69e7-222c-45b1-9d9c-6e2651f5713c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:51.918860 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3a6b69e7-222c-45b1-9d9c-6e2651f5713c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:51.919298 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3a6b69e7-222c-45b1-9d9c-6e2651f5713c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:52.334351 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cb6d5efc-7701-4af0-8b57-82063662b0dd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:52.334900 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-cb6d5efc-7701-4af0-8b57-82063662b0dd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:52.341131 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb6d5efc-7701-4af0-8b57-82063662b0dd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:52.341584 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb6d5efc-7701-4af0-8b57-82063662b0dd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:52.342354 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb6d5efc-7701-4af0-8b57-82063662b0dd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:52.342881 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cb6d5efc-7701-4af0-8b57-82063662b0dd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:52.404744 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-cb6d5efc-7701-4af0-8b57-82063662b0dd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:52.412510 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cb6d5efc-7701-4af0-8b57-82063662b0dd tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1380 microversion: 2.1 time: 0.082206 Jul 14 12:25:52.413075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 509/1005] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:52 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1380 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:25:53.430376 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c208bff1-f6d8-4fe8-99b4-c138e07feb65 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:53.431053 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c208bff1-f6d8-4fe8-99b4-c138e07feb65 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:53.437460 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c208bff1-f6d8-4fe8-99b4-c138e07feb65 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:53.437910 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c208bff1-f6d8-4fe8-99b4-c138e07feb65 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:53.438721 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c208bff1-f6d8-4fe8-99b4-c138e07feb65 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:53.439185 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c208bff1-f6d8-4fe8-99b4-c138e07feb65 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:53.499962 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c208bff1-f6d8-4fe8-99b4-c138e07feb65 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:53.507927 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c208bff1-f6d8-4fe8-99b4-c138e07feb65 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1380 microversion: 2.1 time: 0.081990 Jul 14 12:25:53.508690 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 510/1006] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:53 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1380 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:25:54.479800 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3a6b69e7-222c-45b1-9d9c-6e2651f5713c tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/os-volume_attachments/607fccc7-5e12-46c6-8ab9-1a6f890c0c00" status: 202 len: 0 microversion: 2.20 time: 2.573390 Jul 14 12:25:54.480417 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 497/1007] 10.222.0.27 () {60 vars in 1456 bytes} [Thu Jul 14 12:25:51 2022] DELETE /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/os-volume_attachments/607fccc7-5e12-46c6-8ab9-1a6f890c0c00 => generated 0 bytes in 2575 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:25:54.526366 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2e9e5450-266b-428a-9467-2a621326f9e0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:54.527059 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2e9e5450-266b-428a-9467-2a621326f9e0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:54.533884 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2e9e5450-266b-428a-9467-2a621326f9e0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:54.534347 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2e9e5450-266b-428a-9467-2a621326f9e0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:54.535167 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2e9e5450-266b-428a-9467-2a621326f9e0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:54.535610 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2e9e5450-266b-428a-9467-2a621326f9e0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:54.539032 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4a4c76bb-6b50-40a0-ae7b-665035be8441 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:25:54.539616 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4a4c76bb-6b50-40a0-ae7b-665035be8441 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:54.545863 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4a4c76bb-6b50-40a0-ae7b-665035be8441 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:54.546315 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4a4c76bb-6b50-40a0-ae7b-665035be8441 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:54.547108 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4a4c76bb-6b50-40a0-ae7b-665035be8441 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:54.547555 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4a4c76bb-6b50-40a0-ae7b-665035be8441 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:54.600711 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2e9e5450-266b-428a-9467-2a621326f9e0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:54.608466 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2e9e5450-266b-428a-9467-2a621326f9e0 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1217 microversion: 2.1 time: 0.087313 Jul 14 12:25:54.609038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 511/1008] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:54 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:54.796669 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4a4c76bb-6b50-40a0-ae7b-665035be8441 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "POST /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/action" status: 202 len: 0 microversion: 2.20 time: 0.261507 Jul 14 12:25:54.797381 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 498/1009] 10.222.0.27 () {62 vars in 1318 bytes} [Thu Jul 14 12:25:54 2022] POST /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 12:25:54.806216 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f24484be-0ffe-4be9-acbf-41baf45d1679 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:54.807090 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f24484be-0ffe-4be9-acbf-41baf45d1679 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:54.819522 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:25:54.819522 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f24484be-0ffe-4be9-acbf-41baf45d1679 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:54.819522 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f24484be-0ffe-4be9-acbf-41baf45d1679 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:54.819522 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f24484be-0ffe-4be9-acbf-41baf45d1679 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:54.819895 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f24484be-0ffe-4be9-acbf-41baf45d1679 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:54.969223 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f24484be-0ffe-4be9-acbf-41baf45d1679 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:54.969223 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f24484be-0ffe-4be9-acbf-41baf45d1679 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:54.969882 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-f24484be-0ffe-4be9-acbf-41baf45d1679 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:54.969882 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f24484be-0ffe-4be9-acbf-41baf45d1679 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1671 microversion: 2.20 time: 0.161293 Jul 14 12:25:54.969882 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 512/1010] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:54 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:55.628674 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:55.628674 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:55.632952 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:55.633700 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:55.634490 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:55.634962 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:55.665851 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:55.666303 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:55.666752 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lazy-loading 'fault' on Instance uuid 905d8954-a633-4e05-a5eb-1bd833799fea {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:25:55.717727 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7489ed79115044388225314714876f24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfa18dfa445442d4be02d187ed24325f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:55.731545 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c8fbca1f-489c-410a-860e-90c7becb3bf9 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 200 len: 1222 microversion: 2.1 time: 0.103324 Jul 14 12:25:55.731545 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 499/1011] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:55 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:25:55.982194 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-70b6f5b6-61a7-45af-9b70-408ef66cea12 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:55.985324 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-70b6f5b6-61a7-45af-9b70-408ef66cea12 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:55.989842 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70b6f5b6-61a7-45af-9b70-408ef66cea12 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:55.990297 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70b6f5b6-61a7-45af-9b70-408ef66cea12 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:55.991123 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70b6f5b6-61a7-45af-9b70-408ef66cea12 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:55.991565 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-70b6f5b6-61a7-45af-9b70-408ef66cea12 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:56.129021 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-70b6f5b6-61a7-45af-9b70-408ef66cea12 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:56.137538 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-70b6f5b6-61a7-45af-9b70-408ef66cea12 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:56.139099 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-70b6f5b6-61a7-45af-9b70-408ef66cea12 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:56.140269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-70b6f5b6-61a7-45af-9b70-408ef66cea12 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1671 microversion: 2.20 time: 0.162081 Jul 14 12:25:56.140831 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 513/1012] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:55 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1671 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:56.742883 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-882343ac-aefe-45d2-a20a-0a4ace68557e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:56.743996 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-882343ac-aefe-45d2-a20a-0a4ace68557e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] [instance: 905d8954-a633-4e05-a5eb-1bd833799fea] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:56.750722 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-882343ac-aefe-45d2-a20a-0a4ace68557e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:56.751212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-882343ac-aefe-45d2-a20a-0a4ace68557e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:56.752010 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-882343ac-aefe-45d2-a20a-0a4ace68557e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:56.752453 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-882343ac-aefe-45d2-a20a-0a4ace68557e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:56.766179 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-882343ac-aefe-45d2-a20a-0a4ace68557e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] HTTP exception thrown: Instance 905d8954-a633-4e05-a5eb-1bd833799fea could not be found. Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-882343ac-aefe-45d2-a20a-0a4ace68557e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Request method failure captured: Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea HTTP/1.1 Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AnvI1Z9YimjbRRTd5eQ_tnDKVZBP3g27HOWjjKTaTDXaaksof7HZ6r8lIF4TegGyKWXQnBYZJlx4VR_B9rB-6Fmag3WXHidQDvoKIYWExI9uiLNp2F6n4G5kL0Ycvt1Ouf3B0RysmER7vz39LSs-gZqsV3Trg6S2jMru2k_yAhoZU8 Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: dfa18dfa445442d4be02d187ed24325f Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-TestShelveInstance-2006736384 Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:25:56.767849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_dfa18dfa445442d4be02d187ed24325f", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/dfa18dfa445442d4be02d187ed24325f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dfa18dfa445442d4be02d187ed24325f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/dfa18dfa445442d4be02d187ed24325f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-TestShelveInstance-2006736384 Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: dfa18dfa445442d4be02d187ed24325f Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-TestShelveInstance-2006736384 Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-TestShelveInstance-2006736384-project Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 7489ed79115044388225314714876f24 Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-TestShelveInstance-2006736384-project Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 905d8954-a633-4e05-a5eb-1bd833799fea could not be found. Jul 14 12:25:56.769541 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '905d8954-a633-4e05-a5eb-1bd833799fea'} Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 905d8954-a633-4e05-a5eb-1bd833799fea could not be found. Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:25:56.770502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 905d8954-a633-4e05-a5eb-1bd833799fea could not be found. Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 905d8954-a633-4e05-a5eb-1bd833799fea could not be found. Jul 14 12:25:56.778927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:25:56.780670 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-882343ac-aefe-45d2-a20a-0a4ace68557e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Returning 404 to user: Instance 905d8954-a633-4e05-a5eb-1bd833799fea could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:25:56.780670 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-882343ac-aefe-45d2-a20a-0a4ace68557e tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea" status: 404 len: 111 microversion: 2.1 time: 0.030321 Jul 14 12:25:56.780670 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 500/1013] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:25:56 2022] GET /compute/v2.1/servers/905d8954-a633-4e05-a5eb-1bd833799fea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:25:57.000539 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-55bc849e-98f5-48c7-b9c8-b0b3d1a403f2 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] Calling method '.version_select at 0x7f0e2673dee0>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:57.105754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-55bc849e-98f5-48c7-b9c8-b0b3d1a403f2 tempest-TestShelveInstance-2006736384 tempest-TestShelveInstance-2006736384-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-70849047" status: 202 len: 0 microversion: 2.1 time: 0.109048 Jul 14 12:25:57.106332 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 514/1014] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:25:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-70849047 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:25:57.159476 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-15521eba-0fbb-469f-ad9f-7f85b757ea30 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:57.160129 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-15521eba-0fbb-469f-ad9f-7f85b757ea30 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:57.168511 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-15521eba-0fbb-469f-ad9f-7f85b757ea30 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:57.168994 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-15521eba-0fbb-469f-ad9f-7f85b757ea30 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:57.169804 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-15521eba-0fbb-469f-ad9f-7f85b757ea30 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:57.170244 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-15521eba-0fbb-469f-ad9f-7f85b757ea30 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:57.499697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-15521eba-0fbb-469f-ad9f-7f85b757ea30 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:57.507740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-15521eba-0fbb-469f-ad9f-7f85b757ea30 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:57.509277 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-15521eba-0fbb-469f-ad9f-7f85b757ea30 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:57.510677 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-15521eba-0fbb-469f-ad9f-7f85b757ea30 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.355518 Jul 14 12:25:57.511302 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 501/1015] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:57 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:58.531604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-569ba373-21a9-428e-b8ec-2ebed2bbea17 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:58.532228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-569ba373-21a9-428e-b8ec-2ebed2bbea17 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:58.538810 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-569ba373-21a9-428e-b8ec-2ebed2bbea17 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:58.542162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-569ba373-21a9-428e-b8ec-2ebed2bbea17 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:58.542162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-569ba373-21a9-428e-b8ec-2ebed2bbea17 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:58.542162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-569ba373-21a9-428e-b8ec-2ebed2bbea17 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:58.674083 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-569ba373-21a9-428e-b8ec-2ebed2bbea17 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:58.683661 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-569ba373-21a9-428e-b8ec-2ebed2bbea17 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:58.685257 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-569ba373-21a9-428e-b8ec-2ebed2bbea17 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:58.686439 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-569ba373-21a9-428e-b8ec-2ebed2bbea17 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.159469 Jul 14 12:25:58.687251 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 515/1016] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:58 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:25:59.705157 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e5623110-09aa-46b2-b81a-89a0641557f3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:25:59.705759 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e5623110-09aa-46b2-b81a-89a0641557f3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:25:59.712439 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e5623110-09aa-46b2-b81a-89a0641557f3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:59.712891 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e5623110-09aa-46b2-b81a-89a0641557f3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:59.713669 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e5623110-09aa-46b2-b81a-89a0641557f3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:25:59.714112 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e5623110-09aa-46b2-b81a-89a0641557f3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:25:59.872567 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e5623110-09aa-46b2-b81a-89a0641557f3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:59.880887 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e5623110-09aa-46b2-b81a-89a0641557f3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:59.882389 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e5623110-09aa-46b2-b81a-89a0641557f3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:25:59.883754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e5623110-09aa-46b2-b81a-89a0641557f3 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.182402 Jul 14 12:25:59.885163 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 502/1017] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:25:59 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:00.907107 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d3ff0e97-2cbd-4ac5-b039-3b05e124270b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:00.907764 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d3ff0e97-2cbd-4ac5-b039-3b05e124270b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:00.916921 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d3ff0e97-2cbd-4ac5-b039-3b05e124270b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:00.918374 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d3ff0e97-2cbd-4ac5-b039-3b05e124270b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:00.919664 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d3ff0e97-2cbd-4ac5-b039-3b05e124270b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:00.920462 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d3ff0e97-2cbd-4ac5-b039-3b05e124270b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:01.085728 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d3ff0e97-2cbd-4ac5-b039-3b05e124270b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:01.093831 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d3ff0e97-2cbd-4ac5-b039-3b05e124270b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:01.094480 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d3ff0e97-2cbd-4ac5-b039-3b05e124270b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:01.095982 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d3ff0e97-2cbd-4ac5-b039-3b05e124270b tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.196687 Jul 14 12:26:01.103013 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 516/1018] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:00 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:02.115391 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7e130017-3be1-42e7-ab98-f22a960c0c3d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:02.116002 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7e130017-3be1-42e7-ab98-f22a960c0c3d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:02.128411 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7e130017-3be1-42e7-ab98-f22a960c0c3d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:02.128862 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7e130017-3be1-42e7-ab98-f22a960c0c3d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:02.129857 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7e130017-3be1-42e7-ab98-f22a960c0c3d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:02.130462 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7e130017-3be1-42e7-ab98-f22a960c0c3d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:02.181326 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:02.359029 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7e130017-3be1-42e7-ab98-f22a960c0c3d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:02.367566 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7e130017-3be1-42e7-ab98-f22a960c0c3d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:02.369523 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7e130017-3be1-42e7-ab98-f22a960c0c3d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:02.370791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7e130017-3be1-42e7-ab98-f22a960c0c3d tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.259485 Jul 14 12:26:02.374374 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 503/1019] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:02 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:03.391325 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b0f3725f-1ff5-4f5f-91b3-a163f9369fd1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:03.391325 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b0f3725f-1ff5-4f5f-91b3-a163f9369fd1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:03.407493 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b0f3725f-1ff5-4f5f-91b3-a163f9369fd1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:03.407948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b0f3725f-1ff5-4f5f-91b3-a163f9369fd1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:03.408717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b0f3725f-1ff5-4f5f-91b3-a163f9369fd1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:03.409147 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b0f3725f-1ff5-4f5f-91b3-a163f9369fd1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:03.416264 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:03.644249 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b0f3725f-1ff5-4f5f-91b3-a163f9369fd1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:03.660808 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b0f3725f-1ff5-4f5f-91b3-a163f9369fd1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:03.665851 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b0f3725f-1ff5-4f5f-91b3-a163f9369fd1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:03.669774 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b0f3725f-1ff5-4f5f-91b3-a163f9369fd1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.283327 Jul 14 12:26:03.680174 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 517/1020] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:03 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:04.687832 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f18ba40a-851d-47fa-bd71-ca2aebd456ec tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:04.688436 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f18ba40a-851d-47fa-bd71-ca2aebd456ec tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:04.707017 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f18ba40a-851d-47fa-bd71-ca2aebd456ec tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:04.707715 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f18ba40a-851d-47fa-bd71-ca2aebd456ec tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:04.708649 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f18ba40a-851d-47fa-bd71-ca2aebd456ec tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:04.713557 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f18ba40a-851d-47fa-bd71-ca2aebd456ec tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:04.900504 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f18ba40a-851d-47fa-bd71-ca2aebd456ec tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:04.912546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f18ba40a-851d-47fa-bd71-ca2aebd456ec tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:04.912546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f18ba40a-851d-47fa-bd71-ca2aebd456ec tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:04.912546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f18ba40a-851d-47fa-bd71-ca2aebd456ec tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.227906 Jul 14 12:26:04.924578 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 504/1021] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:04 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:05.931436 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-56bb64fd-065f-4bd8-8b2c-ebf72d4b3cda tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:05.932043 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-56bb64fd-065f-4bd8-8b2c-ebf72d4b3cda tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:05.938846 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-56bb64fd-065f-4bd8-8b2c-ebf72d4b3cda tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:05.939379 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-56bb64fd-065f-4bd8-8b2c-ebf72d4b3cda tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:05.940271 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-56bb64fd-065f-4bd8-8b2c-ebf72d4b3cda tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:05.940798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-56bb64fd-065f-4bd8-8b2c-ebf72d4b3cda tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:06.105077 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-56bb64fd-065f-4bd8-8b2c-ebf72d4b3cda tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:06.115282 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-56bb64fd-065f-4bd8-8b2c-ebf72d4b3cda tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:06.117391 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-56bb64fd-065f-4bd8-8b2c-ebf72d4b3cda tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:06.119533 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-56bb64fd-065f-4bd8-8b2c-ebf72d4b3cda tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.192110 Jul 14 12:26:06.125707 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 518/1022] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:05 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:26:07.138875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-6975c76c-10ed-42ae-8bd7-ccf620f0866e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:07.140198 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-6975c76c-10ed-42ae-8bd7-ccf620f0866e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:07.147525 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6975c76c-10ed-42ae-8bd7-ccf620f0866e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:07.148218 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6975c76c-10ed-42ae-8bd7-ccf620f0866e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:07.149055 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6975c76c-10ed-42ae-8bd7-ccf620f0866e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:07.149482 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-6975c76c-10ed-42ae-8bd7-ccf620f0866e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:07.304841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6975c76c-10ed-42ae-8bd7-ccf620f0866e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:07.314201 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6975c76c-10ed-42ae-8bd7-ccf620f0866e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:07.315849 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-6975c76c-10ed-42ae-8bd7-ccf620f0866e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:07.327767 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-6975c76c-10ed-42ae-8bd7-ccf620f0866e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.193846 Jul 14 12:26:07.329064 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 505/1023] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:07 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:08.352490 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5b65e542-06ca-4fab-8a08-54ee089b651a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:08.353222 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5b65e542-06ca-4fab-8a08-54ee089b651a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:08.361798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b65e542-06ca-4fab-8a08-54ee089b651a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:08.362455 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b65e542-06ca-4fab-8a08-54ee089b651a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:08.363505 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b65e542-06ca-4fab-8a08-54ee089b651a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:08.364067 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b65e542-06ca-4fab-8a08-54ee089b651a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:08.549495 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5b65e542-06ca-4fab-8a08-54ee089b651a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:08.558971 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5b65e542-06ca-4fab-8a08-54ee089b651a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:08.560769 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5b65e542-06ca-4fab-8a08-54ee089b651a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:08.562151 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5b65e542-06ca-4fab-8a08-54ee089b651a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.213828 Jul 14 12:26:08.573195 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 519/1024] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:08 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:09.580604 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-98ff3081-d9a0-4c50-b1a5-34647fd97c15 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:09.581221 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-98ff3081-d9a0-4c50-b1a5-34647fd97c15 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:09.590144 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-98ff3081-d9a0-4c50-b1a5-34647fd97c15 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:09.590736 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-98ff3081-d9a0-4c50-b1a5-34647fd97c15 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:09.591702 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-98ff3081-d9a0-4c50-b1a5-34647fd97c15 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:09.592138 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-98ff3081-d9a0-4c50-b1a5-34647fd97c15 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:09.740696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-98ff3081-d9a0-4c50-b1a5-34647fd97c15 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:09.751521 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-98ff3081-d9a0-4c50-b1a5-34647fd97c15 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:09.753343 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-98ff3081-d9a0-4c50-b1a5-34647fd97c15 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:09.754909 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-98ff3081-d9a0-4c50-b1a5-34647fd97c15 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.178512 Jul 14 12:26:09.756137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 506/1025] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:09 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:10.773486 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-14510a18-004c-4402-81a4-a3cc885460ea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:10.774145 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-14510a18-004c-4402-81a4-a3cc885460ea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:10.783304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-14510a18-004c-4402-81a4-a3cc885460ea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:10.783304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-14510a18-004c-4402-81a4-a3cc885460ea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:10.783304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-14510a18-004c-4402-81a4-a3cc885460ea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:10.783590 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-14510a18-004c-4402-81a4-a3cc885460ea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:10.920282 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-14510a18-004c-4402-81a4-a3cc885460ea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:10.928217 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-14510a18-004c-4402-81a4-a3cc885460ea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:10.929946 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-14510a18-004c-4402-81a4-a3cc885460ea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:10.931227 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-14510a18-004c-4402-81a4-a3cc885460ea tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.161615 Jul 14 12:26:10.931948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 520/1026] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:10 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:11.950242 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bc90c049-22d5-43b4-9320-e11041ac6519 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:11.950871 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-bc90c049-22d5-43b4-9320-e11041ac6519 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:11.957273 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc90c049-22d5-43b4-9320-e11041ac6519 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:11.957711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc90c049-22d5-43b4-9320-e11041ac6519 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:11.958461 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc90c049-22d5-43b4-9320-e11041ac6519 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:11.958985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bc90c049-22d5-43b4-9320-e11041ac6519 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:12.087039 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bc90c049-22d5-43b4-9320-e11041ac6519 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:12.095826 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bc90c049-22d5-43b4-9320-e11041ac6519 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:12.097344 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bc90c049-22d5-43b4-9320-e11041ac6519 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:12.098506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bc90c049-22d5-43b4-9320-e11041ac6519 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.152978 Jul 14 12:26:12.099631 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 507/1027] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:11 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:13.117218 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-bf09b35d-884b-4b2a-9eeb-e164c5245a06 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:13.118051 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-bf09b35d-884b-4b2a-9eeb-e164c5245a06 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:13.125496 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bf09b35d-884b-4b2a-9eeb-e164c5245a06 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:13.126028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bf09b35d-884b-4b2a-9eeb-e164c5245a06 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:13.126910 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bf09b35d-884b-4b2a-9eeb-e164c5245a06 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:13.127438 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-bf09b35d-884b-4b2a-9eeb-e164c5245a06 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:13.262619 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-bf09b35d-884b-4b2a-9eeb-e164c5245a06 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:13.270593 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-bf09b35d-884b-4b2a-9eeb-e164c5245a06 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:13.272156 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-bf09b35d-884b-4b2a-9eeb-e164c5245a06 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:13.273305 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-bf09b35d-884b-4b2a-9eeb-e164c5245a06 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.160026 Jul 14 12:26:13.273868 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 521/1028] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:13 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 12:26:14.291687 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ab7213f6-9bd5-4853-94c4-30c32b303187 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:14.292212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ab7213f6-9bd5-4853-94c4-30c32b303187 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:14.298953 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ab7213f6-9bd5-4853-94c4-30c32b303187 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:14.299398 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ab7213f6-9bd5-4853-94c4-30c32b303187 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:14.300161 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ab7213f6-9bd5-4853-94c4-30c32b303187 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:14.300648 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ab7213f6-9bd5-4853-94c4-30c32b303187 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:14.434450 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ab7213f6-9bd5-4853-94c4-30c32b303187 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:14.441762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-af19ed66-ed82-463e-8408-b5836ec52d56 req-2ba3f458-0e8c-448f-8aaa-6d8ed24f048e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a356720e-5371-4d02-bd6d-5293e39ed68a", "name": "network-vif-plugged", "status": "completed", "tag": "3c14bf32-ee21-46df-a087-dc33eef08a69"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:26:14.443156 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ab7213f6-9bd5-4853-94c4-30c32b303187 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:14.444807 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ab7213f6-9bd5-4853-94c4-30c32b303187 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:14.445980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ab7213f6-9bd5-4853-94c4-30c32b303187 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.158376 Jul 14 12:26:14.446546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 508/1029] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:14 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:14.452732 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-af19ed66-ed82-463e-8408-b5836ec52d56 req-2ba3f458-0e8c-448f-8aaa-6d8ed24f048e service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:14.453344 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-af19ed66-ed82-463e-8408-b5836ec52d56 req-2ba3f458-0e8c-448f-8aaa-6d8ed24f048e service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:14.464981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-af19ed66-ed82-463e-8408-b5836ec52d56 req-2ba3f458-0e8c-448f-8aaa-6d8ed24f048e service nova] Creating event network-vif-plugged:3c14bf32-ee21-46df-a087-dc33eef08a69 for instance a356720e-5371-4d02-bd6d-5293e39ed68a on hv-cinder-84890 Jul 14 12:26:14.469881 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-af19ed66-ed82-463e-8408-b5836ec52d56 req-2ba3f458-0e8c-448f-8aaa-6d8ed24f048e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032519 Jul 14 12:26:14.470449 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 522/1030] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:26:15.465125 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3da8b730-461e-4125-aaa4-3abed3f8bc05 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:15.465908 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3da8b730-461e-4125-aaa4-3abed3f8bc05 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:15.472583 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3da8b730-461e-4125-aaa4-3abed3f8bc05 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:15.474912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3da8b730-461e-4125-aaa4-3abed3f8bc05 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:15.474912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3da8b730-461e-4125-aaa4-3abed3f8bc05 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:15.474912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3da8b730-461e-4125-aaa4-3abed3f8bc05 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:15.612917 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3da8b730-461e-4125-aaa4-3abed3f8bc05 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:15.621043 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3da8b730-461e-4125-aaa4-3abed3f8bc05 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:15.622536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3da8b730-461e-4125-aaa4-3abed3f8bc05 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:15.623713 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3da8b730-461e-4125-aaa4-3abed3f8bc05 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.163377 Jul 14 12:26:15.624286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 509/1031] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:15 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:16.651100 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ec897fea-c763-48bb-9a85-428c855e79db tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:16.652099 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ec897fea-c763-48bb-9a85-428c855e79db tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:16.658281 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ec897fea-c763-48bb-9a85-428c855e79db tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:16.658726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ec897fea-c763-48bb-9a85-428c855e79db tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:16.659546 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ec897fea-c763-48bb-9a85-428c855e79db tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:16.659977 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ec897fea-c763-48bb-9a85-428c855e79db tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:16.804270 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ec897fea-c763-48bb-9a85-428c855e79db tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:16.816668 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ec897fea-c763-48bb-9a85-428c855e79db tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:16.819125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ec897fea-c763-48bb-9a85-428c855e79db tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:16.820299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ec897fea-c763-48bb-9a85-428c855e79db tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.175570 Jul 14 12:26:16.827081 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 523/1032] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:16 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:17.843009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-188a5c32-d97b-435f-bbb6-031594f6b07a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:17.844174 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-188a5c32-d97b-435f-bbb6-031594f6b07a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:17.852065 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-188a5c32-d97b-435f-bbb6-031594f6b07a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:17.852998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-188a5c32-d97b-435f-bbb6-031594f6b07a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:17.853463 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-188a5c32-d97b-435f-bbb6-031594f6b07a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:17.853905 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-188a5c32-d97b-435f-bbb6-031594f6b07a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:17.997819 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-188a5c32-d97b-435f-bbb6-031594f6b07a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:18.005687 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-188a5c32-d97b-435f-bbb6-031594f6b07a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:18.007268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-188a5c32-d97b-435f-bbb6-031594f6b07a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:18.008418 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-188a5c32-d97b-435f-bbb6-031594f6b07a tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1729 microversion: 2.20 time: 0.169313 Jul 14 12:26:18.008998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 510/1033] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:17 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:19.027300 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9f3b82bb-7f8e-42e6-b952-845491ec4037 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:19.027927 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-9f3b82bb-7f8e-42e6-b952-845491ec4037 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:19.034474 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f3b82bb-7f8e-42e6-b952-845491ec4037 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:19.034962 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f3b82bb-7f8e-42e6-b952-845491ec4037 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:19.035716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f3b82bb-7f8e-42e6-b952-845491ec4037 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:19.036144 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f3b82bb-7f8e-42e6-b952-845491ec4037 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:19.169822 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9f3b82bb-7f8e-42e6-b952-845491ec4037 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:19.177938 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9f3b82bb-7f8e-42e6-b952-845491ec4037 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:19.179427 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9f3b82bb-7f8e-42e6-b952-845491ec4037 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:19.180682 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9f3b82bb-7f8e-42e6-b952-845491ec4037 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1716 microversion: 2.20 time: 0.157743 Jul 14 12:26:19.181306 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 524/1034] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:19 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1716 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:31.505312 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bb1eff84-64b1-4dcf-8912-101f98dcf0ca tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:31.505877 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-bb1eff84-64b1-4dcf-8912-101f98dcf0ca tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:31.508269 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=37 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:31.508912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=44 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:31.514185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bb1eff84-64b1-4dcf-8912-101f98dcf0ca tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:31.514632 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bb1eff84-64b1-4dcf-8912-101f98dcf0ca tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:31.515438 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bb1eff84-64b1-4dcf-8912-101f98dcf0ca tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:31.515873 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bb1eff84-64b1-4dcf-8912-101f98dcf0ca tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:31.539133 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bb1eff84-64b1-4dcf-8912-101f98dcf0ca tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/ips" status: 200 len: 149 microversion: 2.1 time: 0.037642 Jul 14 12:26:31.539701 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 511/1035] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:26:31 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:26:33.342684 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-40bd5976-3e6e-4b6d-82a9-b6c7906095d0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a481a6e-eb51-4cad-bf69-3da4e728b757"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:26:33.345232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-40bd5976-3e6e-4b6d-82a9-b6c7906095d0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:33.346066 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:33.346804 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=42 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:33.351440 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40bd5976-3e6e-4b6d-82a9-b6c7906095d0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:33.351885 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40bd5976-3e6e-4b6d-82a9-b6c7906095d0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:33.352648 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40bd5976-3e6e-4b6d-82a9-b6c7906095d0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:33.353078 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-40bd5976-3e6e-4b6d-82a9-b6c7906095d0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:33.958338 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-40bd5976-3e6e-4b6d-82a9-b6c7906095d0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.620005 Jul 14 12:26:33.958999 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 525/1036] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:26:33 2022] POST /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-volume_attachments => generated 194 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:26:41.459634 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-33d817ab-d7fa-49fe-90a9-b075497b90cd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: .version_select at 0x7f0e284a2f70>, body: {"keypair": {"name": "tempest-keypair-1899658983", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBALAu0l428Kd4Tdz/krHCJPhs78ASHFomqXY70pryprGbhhzcBYsoOPq3W5d/Q3O1J7HnVYO/lzflM24l62Q80RMl5dFm5miztvpW2Xy4ngqs5jpWxXOFHRJT2LaNJYrIw=="}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:26:41.475012 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-33d817ab-d7fa-49fe-90a9-b075497b90cd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:26:41.480385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-33d817ab-d7fa-49fe-90a9-b075497b90cd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for user 8d824401d1454a2bb19d7628e38b256a and project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:26:41.602415 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-33d817ab-d7fa-49fe-90a9-b075497b90cd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.146621 Jul 14 12:26:41.603137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 512/1037] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 12:26:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:26:44.023341 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:44.024264 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:44.029158 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2042933865", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "738fa312-d388-4da8-be3f-aad30d233548"}], "security_groups": [{"name": "tempest-securitygroup--1715216615"}], "key_name": "tempest-keypair-1899658983", "user_data": "}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:26:44.134823 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.network.neutron [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] validate_networks() for [('738fa312-d388-4da8-be3f-aad30d233548', None, None, None, None, None)] {{(pid=118262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:26:44.497972 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Flavor limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:26:44.498397 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Image limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:26:44.498904 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Flavor pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:26:44.499345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Image pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:26:44.499754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:26:44.508457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:44.508903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:44.509699 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:44.510130 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:44.527550 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:26:44.531470 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for user 8d824401d1454a2bb19d7628e38b256a and project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:26:44.542926 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Going to run 1 instances... {{(pid=118262) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:26:44.545262 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:26:44.663795 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b20c6f3f-a12f-48c7-9943-63ff938b714e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.641854 Jul 14 12:26:44.664451 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 526/1038] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:26:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:26:44.674734 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9635186c-2e5a-491c-a9d7-fcb33e5d19bb tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:44.675427 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9635186c-2e5a-491c-a9d7-fcb33e5d19bb tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:44.732662 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-9635186c-2e5a-491c-a9d7-fcb33e5d19bb tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:44.740618 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9635186c-2e5a-491c-a9d7-fcb33e5d19bb tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1242 microversion: 2.1 time: 0.069899 Jul 14 12:26:44.748299 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 513/1039] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:44 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1242 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:45.759077 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-02f0c415-cc26-449f-abe2-96ce229bf2fe tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:45.759707 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-02f0c415-cc26-449f-abe2-96ce229bf2fe tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:45.767318 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-02f0c415-cc26-449f-abe2-96ce229bf2fe tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:45.767768 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-02f0c415-cc26-449f-abe2-96ce229bf2fe tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:45.768532 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-02f0c415-cc26-449f-abe2-96ce229bf2fe tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:45.768966 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-02f0c415-cc26-449f-abe2-96ce229bf2fe tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:45.828709 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-02f0c415-cc26-449f-abe2-96ce229bf2fe tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:45.869733 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-02f0c415-cc26-449f-abe2-96ce229bf2fe tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1246 microversion: 2.1 time: 0.114891 Jul 14 12:26:45.870560 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 527/1040] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:45 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1246 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:46.886902 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2e8cd517-8056-4870-bce3-a6c10f23318f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:46.887524 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2e8cd517-8056-4870-bce3-a6c10f23318f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:46.893985 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e8cd517-8056-4870-bce3-a6c10f23318f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:46.894468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e8cd517-8056-4870-bce3-a6c10f23318f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:46.895272 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e8cd517-8056-4870-bce3-a6c10f23318f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:46.895713 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e8cd517-8056-4870-bce3-a6c10f23318f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:46.967609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2e8cd517-8056-4870-bce3-a6c10f23318f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:46.975884 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2e8cd517-8056-4870-bce3-a6c10f23318f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1294 microversion: 2.1 time: 0.092798 Jul 14 12:26:46.976780 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 514/1041] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:46 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:47.993311 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fefa9d53-b66d-4883-abd3-2ccf69fbd83c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:47.993928 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fefa9d53-b66d-4883-abd3-2ccf69fbd83c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:48.001663 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fefa9d53-b66d-4883-abd3-2ccf69fbd83c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:48.002120 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fefa9d53-b66d-4883-abd3-2ccf69fbd83c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:48.003010 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fefa9d53-b66d-4883-abd3-2ccf69fbd83c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:48.003457 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fefa9d53-b66d-4883-abd3-2ccf69fbd83c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:48.066882 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-fefa9d53-b66d-4883-abd3-2ccf69fbd83c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:48.074535 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fefa9d53-b66d-4883-abd3-2ccf69fbd83c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1300 microversion: 2.1 time: 0.085067 Jul 14 12:26:48.075152 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 528/1042] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:47 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:49.091614 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f9d5048e-1ac7-40fb-bc99-acb684ac8578 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:49.092902 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f9d5048e-1ac7-40fb-bc99-acb684ac8578 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:49.099857 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f9d5048e-1ac7-40fb-bc99-acb684ac8578 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:49.100047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f9d5048e-1ac7-40fb-bc99-acb684ac8578 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:49.100741 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f9d5048e-1ac7-40fb-bc99-acb684ac8578 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:49.101367 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f9d5048e-1ac7-40fb-bc99-acb684ac8578 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:49.315829 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-f9d5048e-1ac7-40fb-bc99-acb684ac8578 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:49.333093 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f9d5048e-1ac7-40fb-bc99-acb684ac8578 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1368 microversion: 2.1 time: 0.236056 Jul 14 12:26:49.333093 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 515/1043] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:49 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:49.489760 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-d7be669a-e444-4bad-ad82-ca9a9e965bab req-3e295ec2-82f3-4153-bf09-2417579c5b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b91abb-69ba-44ce-af93-7223f9377f04", "tag": "02899756-e0cb-4d18-b33a-eb06282eef53"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:26:49.500488 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-d7be669a-e444-4bad-ad82-ca9a9e965bab req-3e295ec2-82f3-4153-bf09-2417579c5b78 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:49.501196 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-d7be669a-e444-4bad-ad82-ca9a9e965bab req-3e295ec2-82f3-4153-bf09-2417579c5b78 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:49.520228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-d7be669a-e444-4bad-ad82-ca9a9e965bab req-3e295ec2-82f3-4153-bf09-2417579c5b78 service nova] Creating event network-changed:02899756-e0cb-4d18-b33a-eb06282eef53 for instance 68b91abb-69ba-44ce-af93-7223f9377f04 on hv-cinder-84890 Jul 14 12:26:49.525220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-d7be669a-e444-4bad-ad82-ca9a9e965bab req-3e295ec2-82f3-4153-bf09-2417579c5b78 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039202 Jul 14 12:26:49.525811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 529/1044] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:26:50.340061 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-035ed893-457e-48c8-8344-dcb989e2c6cc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:50.340680 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-035ed893-457e-48c8-8344-dcb989e2c6cc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:50.347816 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-035ed893-457e-48c8-8344-dcb989e2c6cc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:50.348267 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-035ed893-457e-48c8-8344-dcb989e2c6cc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:50.349041 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-035ed893-457e-48c8-8344-dcb989e2c6cc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:50.349577 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-035ed893-457e-48c8-8344-dcb989e2c6cc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:50.490621 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-035ed893-457e-48c8-8344-dcb989e2c6cc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:50.498683 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-035ed893-457e-48c8-8344-dcb989e2c6cc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1368 microversion: 2.1 time: 0.161989 Jul 14 12:26:50.499405 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 516/1045] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:50 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:51.516544 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d76894fc-cec5-4ba7-879e-51c581e51b08 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:51.517131 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d76894fc-cec5-4ba7-879e-51c581e51b08 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:51.523481 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d76894fc-cec5-4ba7-879e-51c581e51b08 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:51.523938 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d76894fc-cec5-4ba7-879e-51c581e51b08 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:51.524711 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d76894fc-cec5-4ba7-879e-51c581e51b08 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:51.525149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d76894fc-cec5-4ba7-879e-51c581e51b08 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:51.662976 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d76894fc-cec5-4ba7-879e-51c581e51b08 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:51.671411 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d76894fc-cec5-4ba7-879e-51c581e51b08 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1368 microversion: 2.1 time: 0.159605 Jul 14 12:26:51.671964 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 530/1046] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:51 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:52.688231 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0f1c5b52-fb35-48f4-a098-f451e28fee8b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:52.688929 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0f1c5b52-fb35-48f4-a098-f451e28fee8b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:52.695426 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0f1c5b52-fb35-48f4-a098-f451e28fee8b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:52.695890 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0f1c5b52-fb35-48f4-a098-f451e28fee8b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:52.696633 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0f1c5b52-fb35-48f4-a098-f451e28fee8b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:52.697065 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0f1c5b52-fb35-48f4-a098-f451e28fee8b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:52.835356 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0f1c5b52-fb35-48f4-a098-f451e28fee8b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:52.843132 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0f1c5b52-fb35-48f4-a098-f451e28fee8b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1368 microversion: 2.1 time: 0.158910 Jul 14 12:26:52.843698 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 517/1047] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:52 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:53.861081 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fa81e220-fa1f-4487-afd3-3f98c227fc3b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:53.861725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fa81e220-fa1f-4487-afd3-3f98c227fc3b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:53.868305 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fa81e220-fa1f-4487-afd3-3f98c227fc3b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:53.868753 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fa81e220-fa1f-4487-afd3-3f98c227fc3b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:53.869521 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fa81e220-fa1f-4487-afd3-3f98c227fc3b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:53.869990 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fa81e220-fa1f-4487-afd3-3f98c227fc3b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:54.001001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-fa81e220-fa1f-4487-afd3-3f98c227fc3b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:54.008458 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fa81e220-fa1f-4487-afd3-3f98c227fc3b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1368 microversion: 2.1 time: 0.152178 Jul 14 12:26:54.009554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 531/1048] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:53 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:54.705555 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-5edcaa25-e010-492d-9924-4d429db3608f req-9e218362-6f07-471c-b30f-94731f2b5bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b91abb-69ba-44ce-af93-7223f9377f04", "name": "network-vif-plugged", "status": "completed", "tag": "02899756-e0cb-4d18-b33a-eb06282eef53"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:26:54.714885 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-5edcaa25-e010-492d-9924-4d429db3608f req-9e218362-6f07-471c-b30f-94731f2b5bfb service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:54.715338 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-5edcaa25-e010-492d-9924-4d429db3608f req-9e218362-6f07-471c-b30f-94731f2b5bfb service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:54.728986 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-5edcaa25-e010-492d-9924-4d429db3608f req-9e218362-6f07-471c-b30f-94731f2b5bfb service nova] Creating event network-vif-plugged:02899756-e0cb-4d18-b33a-eb06282eef53 for instance 68b91abb-69ba-44ce-af93-7223f9377f04 on hv-cinder-84890 Jul 14 12:26:54.735626 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-5edcaa25-e010-492d-9924-4d429db3608f req-9e218362-6f07-471c-b30f-94731f2b5bfb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033476 Jul 14 12:26:54.736231 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 518/1049] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:26:55.025725 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9bd97149-5f69-444d-86d2-bc7649724d93 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:55.026339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-9bd97149-5f69-444d-86d2-bc7649724d93 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:55.028321 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:55.029008 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=6 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:55.035153 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9bd97149-5f69-444d-86d2-bc7649724d93 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:55.035650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9bd97149-5f69-444d-86d2-bc7649724d93 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:55.036463 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9bd97149-5f69-444d-86d2-bc7649724d93 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:55.036872 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9bd97149-5f69-444d-86d2-bc7649724d93 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:55.174453 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9bd97149-5f69-444d-86d2-bc7649724d93 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:55.182122 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9bd97149-5f69-444d-86d2-bc7649724d93 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1368 microversion: 2.1 time: 0.160528 Jul 14 12:26:55.184650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 532/1050] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:55 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:56.200220 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-84c0aeaf-df5f-4942-ae41-9a236d73957a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:56.200988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-84c0aeaf-df5f-4942-ae41-9a236d73957a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:56.203999 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=6 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:26:56.209727 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84c0aeaf-df5f-4942-ae41-9a236d73957a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:56.213757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84c0aeaf-df5f-4942-ae41-9a236d73957a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:56.213757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84c0aeaf-df5f-4942-ae41-9a236d73957a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:56.213757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-84c0aeaf-df5f-4942-ae41-9a236d73957a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:56.349406 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-84c0aeaf-df5f-4942-ae41-9a236d73957a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:56.356957 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-84c0aeaf-df5f-4942-ae41-9a236d73957a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1368 microversion: 2.1 time: 0.161201 Jul 14 12:26:56.357515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 519/1051] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:56 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:57.375997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2636a4b7-db7e-459e-b6d3-c07d9f7846b8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:57.376546 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2636a4b7-db7e-459e-b6d3-c07d9f7846b8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:57.383912 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2636a4b7-db7e-459e-b6d3-c07d9f7846b8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:57.384443 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2636a4b7-db7e-459e-b6d3-c07d9f7846b8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:57.385210 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2636a4b7-db7e-459e-b6d3-c07d9f7846b8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:57.385641 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2636a4b7-db7e-459e-b6d3-c07d9f7846b8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:57.519548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-2636a4b7-db7e-459e-b6d3-c07d9f7846b8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:57.527181 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2636a4b7-db7e-459e-b6d3-c07d9f7846b8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1559 microversion: 2.1 time: 0.157787 Jul 14 12:26:57.527754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 533/1052] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:26:57 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:57.543532 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4217c732-d759-4631-9f36-ca00c9f88421 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:57.544063 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4217c732-d759-4631-9f36-ca00c9f88421 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:57.550944 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4217c732-d759-4631-9f36-ca00c9f88421 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:57.551391 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4217c732-d759-4631-9f36-ca00c9f88421 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:57.552148 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4217c732-d759-4631-9f36-ca00c9f88421 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:57.552580 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4217c732-d759-4631-9f36-ca00c9f88421 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:57.631256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4217c732-d759-4631-9f36-ca00c9f88421 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091703 Jul 14 12:26:57.631846 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 520/1053] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 12:26:57 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:26:58.148993 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3af696f6-174a-4a5c-953f-3ea2588d45bd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:58.149949 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3af696f6-174a-4a5c-953f-3ea2588d45bd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:58.157215 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3af696f6-174a-4a5c-953f-3ea2588d45bd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:58.157775 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3af696f6-174a-4a5c-953f-3ea2588d45bd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:58.158716 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3af696f6-174a-4a5c-953f-3ea2588d45bd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:58.159180 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3af696f6-174a-4a5c-953f-3ea2588d45bd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:58.194431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3af696f6-174a-4a5c-953f-3ea2588d45bd tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049519 Jul 14 12:26:58.195235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 534/1054] 10.222.0.27 () {60 vars in 1342 bytes} [Thu Jul 14 12:26:58 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:26:58.256980 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-efd9edf0-96fc-4905-822f-702a74c26762 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:58.257474 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-efd9edf0-96fc-4905-822f-702a74c26762 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:58.264019 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efd9edf0-96fc-4905-822f-702a74c26762 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:58.265081 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efd9edf0-96fc-4905-822f-702a74c26762 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:58.265911 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efd9edf0-96fc-4905-822f-702a74c26762 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:58.266399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-efd9edf0-96fc-4905-822f-702a74c26762 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:58.295903 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-efd9edf0-96fc-4905-822f-702a74c26762 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Going to try to terminate instance {{(pid=118263) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:26:58.621194 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-efd9edf0-96fc-4905-822f-702a74c26762 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 204 len: 0 microversion: 2.20 time: 0.367746 Jul 14 12:26:58.621907 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 521/1055] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jul 14 12:26:58 2022] DELETE /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 12:26:58.630618 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d0bb5bb6-0fae-43da-b0e2-70ec04682d7e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:58.631252 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d0bb5bb6-0fae-43da-b0e2-70ec04682d7e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:58.637691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d0bb5bb6-0fae-43da-b0e2-70ec04682d7e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:58.638125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d0bb5bb6-0fae-43da-b0e2-70ec04682d7e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:58.638909 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d0bb5bb6-0fae-43da-b0e2-70ec04682d7e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:58.639992 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d0bb5bb6-0fae-43da-b0e2-70ec04682d7e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:58.776930 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d0bb5bb6-0fae-43da-b0e2-70ec04682d7e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:58.785092 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d0bb5bb6-0fae-43da-b0e2-70ec04682d7e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:58.786806 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d0bb5bb6-0fae-43da-b0e2-70ec04682d7e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:58.791225 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d0bb5bb6-0fae-43da-b0e2-70ec04682d7e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.161450 Jul 14 12:26:58.791225 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 535/1056] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:58 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:26:58.917300 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-b303629f-ca39-4a34-8048-111706fc065e req-b3aec4d6-8643-4ad6-8640-2122845e2935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68b91abb-69ba-44ce-af93-7223f9377f04", "tag": "02899756-e0cb-4d18-b33a-eb06282eef53"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:26:58.927152 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-b303629f-ca39-4a34-8048-111706fc065e req-b3aec4d6-8643-4ad6-8640-2122845e2935 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:58.927793 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-b303629f-ca39-4a34-8048-111706fc065e req-b3aec4d6-8643-4ad6-8640-2122845e2935 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:58.940821 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-b303629f-ca39-4a34-8048-111706fc065e req-b3aec4d6-8643-4ad6-8640-2122845e2935 service nova] Creating event network-changed:02899756-e0cb-4d18-b33a-eb06282eef53 for instance 68b91abb-69ba-44ce-af93-7223f9377f04 on hv-cinder-84890 Jul 14 12:26:58.945811 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-b303629f-ca39-4a34-8048-111706fc065e req-b3aec4d6-8643-4ad6-8640-2122845e2935 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032678 Jul 14 12:26:58.946517 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 522/1057] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:26:59.809944 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-da5e970d-1c38-43c6-9c20-822608189839 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:26:59.810895 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-da5e970d-1c38-43c6-9c20-822608189839 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:26:59.817860 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da5e970d-1c38-43c6-9c20-822608189839 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:59.818295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da5e970d-1c38-43c6-9c20-822608189839 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:59.819116 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da5e970d-1c38-43c6-9c20-822608189839 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:26:59.819559 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-da5e970d-1c38-43c6-9c20-822608189839 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:26:59.958581 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-da5e970d-1c38-43c6-9c20-822608189839 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:59.967041 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-da5e970d-1c38-43c6-9c20-822608189839 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:59.969233 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-da5e970d-1c38-43c6-9c20-822608189839 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:26:59.970406 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-da5e970d-1c38-43c6-9c20-822608189839 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.164649 Jul 14 12:26:59.970993 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 536/1058] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:26:59 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:27:00.995025 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5afffd5e-e6eb-414f-adbe-d0c2a64e59f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:00.995728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5afffd5e-e6eb-414f-adbe-d0c2a64e59f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:01.002628 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5afffd5e-e6eb-414f-adbe-d0c2a64e59f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:01.003104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5afffd5e-e6eb-414f-adbe-d0c2a64e59f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:01.003879 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5afffd5e-e6eb-414f-adbe-d0c2a64e59f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:01.004320 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5afffd5e-e6eb-414f-adbe-d0c2a64e59f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:01.228538 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5afffd5e-e6eb-414f-adbe-d0c2a64e59f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:01.237377 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5afffd5e-e6eb-414f-adbe-d0c2a64e59f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:01.238920 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5afffd5e-e6eb-414f-adbe-d0c2a64e59f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:01.240090 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5afffd5e-e6eb-414f-adbe-d0c2a64e59f1 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1722 microversion: 2.20 time: 0.249938 Jul 14 12:27:01.240861 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 523/1059] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:27:00 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:27:01.707366 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-b9fc6341-0caf-4f4b-a5c8-0a68d88c3d1b req-a1f320e1-7bad-4b29-af26-64b994e9bba7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a356720e-5371-4d02-bd6d-5293e39ed68a", "name": "network-vif-deleted", "tag": "3c14bf32-ee21-46df-a087-dc33eef08a69"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:27:01.717075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-b9fc6341-0caf-4f4b-a5c8-0a68d88c3d1b req-a1f320e1-7bad-4b29-af26-64b994e9bba7 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:01.717594 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-b9fc6341-0caf-4f4b-a5c8-0a68d88c3d1b req-a1f320e1-7bad-4b29-af26-64b994e9bba7 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:01.733992 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-b9fc6341-0caf-4f4b-a5c8-0a68d88c3d1b req-a1f320e1-7bad-4b29-af26-64b994e9bba7 service nova] Creating event network-vif-deleted:3c14bf32-ee21-46df-a087-dc33eef08a69 for instance a356720e-5371-4d02-bd6d-5293e39ed68a on hv-cinder-84890 Jul 14 12:27:01.739695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-b9fc6341-0caf-4f4b-a5c8-0a68d88c3d1b req-a1f320e1-7bad-4b29-af26-64b994e9bba7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Jul 14 12:27:01.746975 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 537/1060] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:27:02.258801 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:02.259650 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:02.266183 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:02.266701 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:02.267569 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:02.268077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:02.300390 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:02.301020 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:02.301861 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lazy-loading 'fault' on Instance uuid a356720e-5371-4d02-bd6d-5293e39ed68a {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:27:02.347734 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:02.356325 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:02.357944 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15e708082e294dd9a0834ef21ea46fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51617cc935204a6cba46c6d4d6a24cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:02.359771 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2ffd072b-e761-4e91-a4fc-7c259ebf66e7 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 200 len: 1372 microversion: 2.20 time: 0.104905 Jul 14 12:27:02.360371 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 524/1061] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:27:02 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 1372 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 12:27:03.378932 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-72d48356-ac8a-4f0c-8049-e25104a548ef tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:03.379548 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-72d48356-ac8a-4f0c-8049-e25104a548ef tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:03.385802 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-72d48356-ac8a-4f0c-8049-e25104a548ef tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:03.386262 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-72d48356-ac8a-4f0c-8049-e25104a548ef tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:03.387056 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-72d48356-ac8a-4f0c-8049-e25104a548ef tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:03.387499 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-72d48356-ac8a-4f0c-8049-e25104a548ef tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:03.401112 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-72d48356-ac8a-4f0c-8049-e25104a548ef tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] HTTP exception thrown: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-72d48356-ac8a-4f0c-8049-e25104a548ef tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Request method failure captured: Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a HTTP/1.1 Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AnpXBrMRIzj9dERuwQuO0tkg8D2X0qXe1xF4tGBtL-5s77dk7eJT2AgDqN8abHwdEgWx40b5cj24YIIyIDP5oItkiZEEgmJqAGU5GdqPRF1OSjh7kzMgtbasf5kTBlowC728qbiigVC1-Om4T6Jtn1HVVBQf-qqT4sev_MvqXP06ss Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:27:03.402719 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51617cc935204a6cba46c6d4d6a24cb3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 15e708082e294dd9a0834ef21ea46fd9 Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:03.404424 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'a356720e-5371-4d02-bd6d-5293e39ed68a'} Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:27:03.406691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:03.408345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:03.409740 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-72d48356-ac8a-4f0c-8049-e25104a548ef tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Returning 404 to user: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:27:03.409740 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-72d48356-ac8a-4f0c-8049-e25104a548ef tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 404 len: 111 microversion: 2.20 time: 0.030047 Jul 14 12:27:03.409740 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 538/1062] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:27:03 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 12:27:03.413456 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-98c4ac03-9043-4610-a956-71fe951ba051 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '.version_select at 0x7f0e2665cc10>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:03.494779 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-98c4ac03-9043-4610-a956-71fe951ba051 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642957141" status: 204 len: 0 microversion: 2.20 time: 0.085010 Jul 14 12:27:03.495368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 525/1063] 10.222.0.27 () {60 vars in 1261 bytes} [Thu Jul 14 12:27:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1642957141 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 12:27:05.755127 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-744b4fb4-f3b6-453f-bbb1-68ab580be3e8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:05.755650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-744b4fb4-f3b6-453f-bbb1-68ab580be3e8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:05.762167 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-744b4fb4-f3b6-453f-bbb1-68ab580be3e8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:05.762616 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-744b4fb4-f3b6-453f-bbb1-68ab580be3e8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:05.763417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-744b4fb4-f3b6-453f-bbb1-68ab580be3e8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:05.763863 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-744b4fb4-f3b6-453f-bbb1-68ab580be3e8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:05.777179 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-744b4fb4-f3b6-453f-bbb1-68ab580be3e8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] HTTP exception thrown: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-744b4fb4-f3b6-453f-bbb1-68ab580be3e8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Request method failure captured: Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: DELETE /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a HTTP/1.1 Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AnpXBrMRIzj9dERuwQuO0tkg8D2X0qXe1xF4tGBtL-5s77dk7eJT2AgDqN8abHwdEgWx40b5cj24YIIyIDP5oItkiZEEgmJqAGU5GdqPRF1OSjh7kzMgtbasf5kTBlowC728qbiigVC1-Om4T6Jtn1HVVBQf-qqT4sev_MvqXP06ss Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:27:05.778717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51617cc935204a6cba46c6d4d6a24cb3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 15e708082e294dd9a0834ef21ea46fd9 Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:05.780489 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'a356720e-5371-4d02-bd6d-5293e39ed68a'} Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:27:05.781569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:05.788754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:05.790280 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-744b4fb4-f3b6-453f-bbb1-68ab580be3e8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Returning 404 to user: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:27:05.790280 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-744b4fb4-f3b6-453f-bbb1-68ab580be3e8 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 404 len: 111 microversion: 2.20 time: 0.029551 Jul 14 12:27:05.790280 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 539/1064] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jul 14 12:27:05 2022] DELETE /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 12:27:05.795858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-47d832a6-3ac7-4129-81b5-1ffc9419603e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:05.796472 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-47d832a6-3ac7-4129-81b5-1ffc9419603e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: a356720e-5371-4d02-bd6d-5293e39ed68a] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:05.803859 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47d832a6-3ac7-4129-81b5-1ffc9419603e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:05.804303 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47d832a6-3ac7-4129-81b5-1ffc9419603e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:05.805100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47d832a6-3ac7-4129-81b5-1ffc9419603e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:05.805531 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-47d832a6-3ac7-4129-81b5-1ffc9419603e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:05.821097 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-47d832a6-3ac7-4129-81b5-1ffc9419603e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] HTTP exception thrown: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-47d832a6-3ac7-4129-81b5-1ffc9419603e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Request method failure captured: Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a HTTP/1.1 Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AnpXBrMRIzj9dERuwQuO0tkg8D2X0qXe1xF4tGBtL-5s77dk7eJT2AgDqN8abHwdEgWx40b5cj24YIIyIDP5oItkiZEEgmJqAGU5GdqPRF1OSjh7kzMgtbasf5kTBlowC728qbiigVC1-Om4T6Jtn1HVVBQf-qqT4sev_MvqXP06ss Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:27:05.822790 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51617cc935204a6cba46c6d4d6a24cb3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 15e708082e294dd9a0834ef21ea46fd9 Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:05.824506 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'a356720e-5371-4d02-bd6d-5293e39ed68a'} Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:27:05.825477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. Jul 14 12:27:05.826976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:27:05.828468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-47d832a6-3ac7-4129-81b5-1ffc9419603e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Returning 404 to user: Instance a356720e-5371-4d02-bd6d-5293e39ed68a could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:27:05.828468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-47d832a6-3ac7-4129-81b5-1ffc9419603e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a" status: 404 len: 111 microversion: 2.20 time: 0.032934 Jul 14 12:27:05.828468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 526/1065] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:27:05 2022] GET /compute/v2.1/servers/a356720e-5371-4d02-bd6d-5293e39ed68a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 12:27:07.072565 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-19628bde-13e3-42ac-8d17-a53e3b5e3809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:07.073070 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-19628bde-13e3-42ac-8d17-a53e3b5e3809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:07.080176 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-19628bde-13e3-42ac-8d17-a53e3b5e3809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:07.080631 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-19628bde-13e3-42ac-8d17-a53e3b5e3809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:07.081406 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-19628bde-13e3-42ac-8d17-a53e3b5e3809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:07.081920 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-19628bde-13e3-42ac-8d17-a53e3b5e3809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:07.096060 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-19628bde-13e3-42ac-8d17-a53e3b5e3809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] HTTP exception thrown: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-19628bde-13e3-42ac-8d17-a53e3b5e3809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Request method failure captured: Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: DELETE /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf HTTP/1.1 Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0AnpXBrMRIzj9dERuwQuO0tkg8D2X0qXe1xF4tGBtL-5s77dk7eJT2AgDqN8abHwdEgWx40b5cj24YIIyIDP5oItkiZEEgmJqAGU5GdqPRF1OSjh7kzMgtbasf5kTBlowC728qbiigVC1-Om4T6Jtn1HVVBQf-qqT4sev_MvqXP06ss Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:27:07.097600 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51617cc935204a6cba46c6d4d6a24cb3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 15e708082e294dd9a0834ef21ea46fd9 Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:27:07.099308 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '4d88a179-83e5-4361-8948-8a2632512eaf'} Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:27:07.100132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:27:07.101337 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:07.102554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-19628bde-13e3-42ac-8d17-a53e3b5e3809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Returning 404 to user: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:27:07.102554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-19628bde-13e3-42ac-8d17-a53e3b5e3809 tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "DELETE /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 404 len: 111 microversion: 2.20 time: 0.030256 Jul 14 12:27:07.102554 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 540/1066] 10.222.0.27 () {60 vars in 1279 bytes} [Thu Jul 14 12:27:07 2022] DELETE /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 12:27:07.107401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8da09019-fc31-444c-bdfc-57c4af33581e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:07.108077 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8da09019-fc31-444c-bdfc-57c4af33581e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] [instance: 4d88a179-83e5-4361-8948-8a2632512eaf] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:07.114744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8da09019-fc31-444c-bdfc-57c4af33581e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:07.117775 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8da09019-fc31-444c-bdfc-57c4af33581e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:07.117775 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8da09019-fc31-444c-bdfc-57c4af33581e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:07.117775 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8da09019-fc31-444c-bdfc-57c4af33581e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:07.130408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-8da09019-fc31-444c-bdfc-57c4af33581e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] HTTP exception thrown: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8da09019-fc31-444c-bdfc-57c4af33581e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Request method failure captured: Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf HTTP/1.1 Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0AnpXBrMRIzj9dERuwQuO0tkg8D2X0qXe1xF4tGBtL-5s77dk7eJT2AgDqN8abHwdEgWx40b5cj24YIIyIDP5oItkiZEEgmJqAGU5GdqPRF1OSjh7kzMgtbasf5kTBlowC728qbiigVC1-Om4T6Jtn1HVVBQf-qqT4sev_MvqXP06ss Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:27:07.131991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_51617cc935204a6cba46c6d4d6a24cb3", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/51617cc935204a6cba46c6d4d6a24cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: 51617cc935204a6cba46c6d4d6a24cb3 Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-814309618 Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 15e708082e294dd9a0834ef21ea46fd9 Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeShelveTestJSON-814309618-project Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:27:07.133696 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '4d88a179-83e5-4361-8948-8a2632512eaf'} Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:27:07.134592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. Jul 14 12:27:07.136080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:27:07.137399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8da09019-fc31-444c-bdfc-57c4af33581e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] Returning 404 to user: Instance 4d88a179-83e5-4361-8948-8a2632512eaf could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:27:07.137399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8da09019-fc31-444c-bdfc-57c4af33581e tempest-AttachVolumeShelveTestJSON-814309618 tempest-AttachVolumeShelveTestJSON-814309618-project] 10.222.0.27 "GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf" status: 404 len: 111 microversion: 2.20 time: 0.029808 Jul 14 12:27:07.137399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 527/1067] 10.222.0.27 () {60 vars in 1276 bytes} [Thu Jul 14 12:27:07 2022] GET /compute/v2.1/servers/4d88a179-83e5-4361-8948-8a2632512eaf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 12:27:38.233622 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-470b1b71-9b00-4c46-9b30-39a25f402687 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:38.234162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-470b1b71-9b00-4c46-9b30-39a25f402687 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:38.236879 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:27:38.237826 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=66 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:27:38.243501 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-470b1b71-9b00-4c46-9b30-39a25f402687 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:38.243952 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-470b1b71-9b00-4c46-9b30-39a25f402687 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:38.249759 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-470b1b71-9b00-4c46-9b30-39a25f402687 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:38.249759 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-470b1b71-9b00-4c46-9b30-39a25f402687 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:38.275504 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-470b1b71-9b00-4c46-9b30-39a25f402687 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:27:38.655460 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-470b1b71-9b00-4c46-9b30-39a25f402687 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 204 len: 0 microversion: 2.1 time: 0.425597 Jul 14 12:27:38.656302 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 541/1068] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:27:38 2022] DELETE /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:27:38.666148 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-5970fddb-7a53-4656-845c-cd763b95a2f4 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:38.668001 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-5970fddb-7a53-4656-845c-cd763b95a2f4 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:38.669920 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:27:38.675153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:27:38.675153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5970fddb-7a53-4656-845c-cd763b95a2f4 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:38.675153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5970fddb-7a53-4656-845c-cd763b95a2f4 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:38.675481 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5970fddb-7a53-4656-845c-cd763b95a2f4 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:38.675763 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-5970fddb-7a53-4656-845c-cd763b95a2f4 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:38.805738 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-5970fddb-7a53-4656-845c-cd763b95a2f4 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:38.813210 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-5970fddb-7a53-4656-845c-cd763b95a2f4 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1577 microversion: 2.1 time: 0.152160 Jul 14 12:27:38.813774 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 528/1069] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:38 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:39.831533 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5b81fa28-e716-4186-a75a-cd5a419a0d68 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:39.832236 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5b81fa28-e716-4186-a75a-cd5a419a0d68 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:39.840942 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b81fa28-e716-4186-a75a-cd5a419a0d68 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:39.840942 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b81fa28-e716-4186-a75a-cd5a419a0d68 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:39.840942 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b81fa28-e716-4186-a75a-cd5a419a0d68 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:39.841376 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5b81fa28-e716-4186-a75a-cd5a419a0d68 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:39.973153 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5b81fa28-e716-4186-a75a-cd5a419a0d68 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:39.983265 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5b81fa28-e716-4186-a75a-cd5a419a0d68 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1577 microversion: 2.1 time: 0.155995 Jul 14 12:27:39.984204 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 542/1070] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:39 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:41.000757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4be3fe0a-e7e7-4559-83f9-ab63999308a7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:41.002195 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4be3fe0a-e7e7-4559-83f9-ab63999308a7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:41.011468 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4be3fe0a-e7e7-4559-83f9-ab63999308a7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:41.012235 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4be3fe0a-e7e7-4559-83f9-ab63999308a7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:41.013084 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4be3fe0a-e7e7-4559-83f9-ab63999308a7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:41.013602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4be3fe0a-e7e7-4559-83f9-ab63999308a7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:41.228279 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-4be3fe0a-e7e7-4559-83f9-ab63999308a7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:41.236226 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4be3fe0a-e7e7-4559-83f9-ab63999308a7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1577 microversion: 2.1 time: 0.239635 Jul 14 12:27:41.236802 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 529/1071] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:40 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1577 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:41.601080 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-7452de13-7f8c-4a01-a839-076dd819056b req-3ce0d474-093d-42e1-86a8-98d1a04fb5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9973bd5-77cb-4f58-8c30-5d0715218db6", "name": "network-vif-deleted", "tag": "90f6fd17-e1da-4664-af50-c1a16671d7a0"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:27:41.610200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-7452de13-7f8c-4a01-a839-076dd819056b req-3ce0d474-093d-42e1-86a8-98d1a04fb5b0 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:41.610702 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-7452de13-7f8c-4a01-a839-076dd819056b req-3ce0d474-093d-42e1-86a8-98d1a04fb5b0 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:41.622949 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-7452de13-7f8c-4a01-a839-076dd819056b req-3ce0d474-093d-42e1-86a8-98d1a04fb5b0 service nova] Creating event network-vif-deleted:90f6fd17-e1da-4664-af50-c1a16671d7a0 for instance c9973bd5-77cb-4f58-8c30-5d0715218db6 on hv-cinder-84890 Jul 14 12:27:41.628056 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-7452de13-7f8c-4a01-a839-076dd819056b req-3ce0d474-093d-42e1-86a8-98d1a04fb5b0 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030872 Jul 14 12:27:41.628688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 543/1072] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:27:42.254046 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:42.254831 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:42.261358 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:42.261906 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:42.262942 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:42.263557 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:42.302799 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:42.303302 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:42.303740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lazy-loading 'fault' on Instance uuid c9973bd5-77cb-4f58-8c30-5d0715218db6 {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:27:42.349447 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:42.357679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-cf6a569b-ad30-438d-aed8-5331533f9972 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 200 len: 1230 microversion: 2.1 time: 0.107598 Jul 14 12:27:42.358844 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 530/1073] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:42 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 1230 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:43.378321 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-431ae9ef-24a3-448d-a9fc-8ce356d2c6b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:43.378321 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-431ae9ef-24a3-448d-a9fc-8ce356d2c6b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:43.385122 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-431ae9ef-24a3-448d-a9fc-8ce356d2c6b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:43.385653 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-431ae9ef-24a3-448d-a9fc-8ce356d2c6b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:43.386436 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-431ae9ef-24a3-448d-a9fc-8ce356d2c6b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:43.386901 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-431ae9ef-24a3-448d-a9fc-8ce356d2c6b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:43.401354 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-431ae9ef-24a3-448d-a9fc-8ce356d2c6b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] HTTP exception thrown: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-431ae9ef-24a3-448d-a9fc-8ce356d2c6b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Request method failure captured: Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 HTTP/1.1 Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Ar_FgLC5zcoTyydSMFTVHf_w9AYcY1dbfJQjdCL7UmUqQgu5Ms3esbnNgdkYAm0LTmzfXr2gxhYbhSGDcA5aTkeVJVfs1NDTBrh35NeeCbLAXpKT2ti495fh5pXqbwfKzBL0L9ULtAvxL8sqG2bGxYyJhp44WPU7ZKuZ1Co4PQgJEo Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: c0d098ca721b409385a08b91d861b295 Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:27:43.403035 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0d098ca721b409385a08b91d861b295", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0d098ca721b409385a08b91d861b295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0d098ca721b409385a08b91d861b295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0d098ca721b409385a08b91d861b295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: c0d098ca721b409385a08b91d861b295 Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-TestVolumeBootPattern-1346970940-project Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: d0adaa092d944202b3279d10e0f94a91 Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-TestVolumeBootPattern-1346970940-project Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:27:43.404485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'c9973bd5-77cb-4f58-8c30-5d0715218db6'} Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:27:43.405373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:27:43.406695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:43.408002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-431ae9ef-24a3-448d-a9fc-8ce356d2c6b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Returning 404 to user: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:27:43.408002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-431ae9ef-24a3-448d-a9fc-8ce356d2c6b8 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 404 len: 111 microversion: 2.1 time: 0.033035 Jul 14 12:27:43.408002 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 544/1074] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:43 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:27:43.500927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-939744834", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153859730", "security_groups": [{"name": "tempest-secgroup-smoke-1834465563"}], "block_device_mapping_v2": [{"uuid": "89bb2c8b-00f8-4d38-9802-e6d3d542b548", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e86e92bf-9b7d-465e-8fb7-65ffe1a278e1"}]}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:27:43.624931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] validate_networks() for [('e86e92bf-9b7d-465e-8fb7-65ffe1a278e1', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:27:43.744466 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-0c999ca1-2283-4b73-a15f-df8ae9600dbd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:43.745434 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-0c999ca1-2283-4b73-a15f-df8ae9600dbd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:43.751695 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0c999ca1-2283-4b73-a15f-df8ae9600dbd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:43.752476 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0c999ca1-2283-4b73-a15f-df8ae9600dbd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:43.753441 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0c999ca1-2283-4b73-a15f-df8ae9600dbd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:43.754047 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-0c999ca1-2283-4b73-a15f-df8ae9600dbd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:43.780130 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-0c999ca1-2283-4b73-a15f-df8ae9600dbd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04/ips" status: 200 len: 151 microversion: 2.1 time: 0.041014 Jul 14 12:27:43.780718 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 545/1075] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:27:43 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:27:43.794343 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a7666a57-40df-474c-8a87-c131f479a532 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a481a6e-eb51-4cad-bf69-3da4e728b757"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:27:43.795455 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a7666a57-40df-474c-8a87-c131f479a532 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:43.801759 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a7666a57-40df-474c-8a87-c131f479a532 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:43.802209 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a7666a57-40df-474c-8a87-c131f479a532 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:43.803001 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a7666a57-40df-474c-8a87-c131f479a532 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:43.803446 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a7666a57-40df-474c-8a87-c131f479a532 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:43.898857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-a7666a57-40df-474c-8a87-c131f479a532 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Invalid volume: volume 1a481a6e-eb51-4cad-bf69-3da4e728b757 is already attached to instances: b11f46c7-a881-4c33-a4b7-96933eebcf57 Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a7666a57-40df-474c-8a87-c131f479a532 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: POST /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04/os-volume_attachments HTTP/1.1 Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 74 Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:27:43.900781 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {"volumeAttachment": {"volumeId": "1a481a6e-eb51-4cad-bf69-3da4e728b757"}} Jul 14 12:27:43.902472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Invalid volume: volume 1a481a6e-eb51-4cad-bf69-3da4e728b757 is already attached to instances: b11f46c7-a881-4c33-a4b7-96933eebcf57 Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'server_id': '68b91abb-69ba-44ce-af93-7223f9377f04', 'body': {'volumeAttachment': {'volumeId': '1a481a6e-eb51-4cad-bf69-3da4e728b757'}}} Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1a481a6e-eb51-4cad-bf69-3da4e728b757 is already attached to instances: b11f46c7-a881-4c33-a4b7-96933eebcf57 Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:43.903390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1a481a6e-eb51-4cad-bf69-3da4e728b757 is already attached to instances: b11f46c7-a881-4c33-a4b7-96933eebcf57 Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:43.904646 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:43.906150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:43.906150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:27:43.906150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:27:43.906150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1a481a6e-eb51-4cad-bf69-3da4e728b757 is already attached to instances: b11f46c7-a881-4c33-a4b7-96933eebcf57 Jul 14 12:27:43.906150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:43.906150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a7666a57-40df-474c-8a87-c131f479a532 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 400 to user: Invalid volume: volume 1a481a6e-eb51-4cad-bf69-3da4e728b757 is already attached to instances: b11f46c7-a881-4c33-a4b7-96933eebcf57 {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:27:43.906150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a7666a57-40df-474c-8a87-c131f479a532 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.115217 Jul 14 12:27:43.906150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 546/1076] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:27:43 2022] POST /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 12:27:43.911140 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a72c9949-845a-43d8-9d00-187e7c0dfe43 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:43.911637 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a72c9949-845a-43d8-9d00-187e7c0dfe43 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:43.918570 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a72c9949-845a-43d8-9d00-187e7c0dfe43 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:43.919049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a72c9949-845a-43d8-9d00-187e7c0dfe43 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:43.919824 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a72c9949-845a-43d8-9d00-187e7c0dfe43 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:43.920259 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a72c9949-845a-43d8-9d00-187e7c0dfe43 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:43.947048 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a72c9949-845a-43d8-9d00-187e7c0dfe43 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:27:44.035939 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:27:44.036456 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:27:44.036929 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:27:44.037368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:27:44.037773 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:27:44.047880 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:44.048317 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:44.049099 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:44.049527 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:44.066119 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Getting quotas for project c0d098ca721b409385a08b91d861b295. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:27:44.070176 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Getting quotas for user d0adaa092d944202b3279d10e0f94a91 and project c0d098ca721b409385a08b91d861b295. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:27:44.128047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:27:44.130206 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='89bb2c8b-00f8-4d38-9802-e6d3d542b548',volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:27:44.220475 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a72c9949-845a-43d8-9d00-187e7c0dfe43 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 204 len: 0 microversion: 2.1 time: 0.312744 Jul 14 12:27:44.221065 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 547/1077] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:27:43 2022] DELETE /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:27:44.230186 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1c6a05d0-f02d-4ce5-a640-a930b8da7a40 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:44.230921 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1c6a05d0-f02d-4ce5-a640-a930b8da7a40 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:44.236873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1c6a05d0-f02d-4ce5-a640-a930b8da7a40 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:44.237316 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1c6a05d0-f02d-4ce5-a640-a930b8da7a40 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:44.238079 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1c6a05d0-f02d-4ce5-a640-a930b8da7a40 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:44.238512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-1c6a05d0-f02d-4ce5-a640-a930b8da7a40 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:44.376590 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1c6a05d0-f02d-4ce5-a640-a930b8da7a40 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:44.384962 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1c6a05d0-f02d-4ce5-a640-a930b8da7a40 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1684 microversion: 2.1 time: 0.159492 Jul 14 12:27:44.385614 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 548/1078] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:44 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:27:44.734925 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-dfcc3753-1683-4246-8b38-3af7f9cc1ad6 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.237925 Jul 14 12:27:44.735585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 531/1079] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:27:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:27:44.746893 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3dac4b42-4334-4b29-87bd-37110a4a7412 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:44.747560 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3dac4b42-4334-4b29-87bd-37110a4a7412 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:44.803841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3dac4b42-4334-4b29-87bd-37110a4a7412 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:44.812495 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3dac4b42-4334-4b29-87bd-37110a4a7412 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1093 microversion: 2.1 time: 0.070674 Jul 14 12:27:44.813078 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 549/1080] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:44 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:45.402296 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ba6bccb5-a7bb-42f1-ae06-3ca602586753 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:45.402945 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ba6bccb5-a7bb-42f1-ae06-3ca602586753 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:45.409187 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ba6bccb5-a7bb-42f1-ae06-3ca602586753 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:45.409630 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ba6bccb5-a7bb-42f1-ae06-3ca602586753 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:45.410384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ba6bccb5-a7bb-42f1-ae06-3ca602586753 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:45.410842 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ba6bccb5-a7bb-42f1-ae06-3ca602586753 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:45.543996 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ba6bccb5-a7bb-42f1-ae06-3ca602586753 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:45.551853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ba6bccb5-a7bb-42f1-ae06-3ca602586753 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1684 microversion: 2.1 time: 0.154260 Jul 14 12:27:45.552422 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 532/1081] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:45 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:45.830547 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3d88f4fa-b675-4670-8210-056557a3c706 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:45.831323 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3d88f4fa-b675-4670-8210-056557a3c706 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:45.838823 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3d88f4fa-b675-4670-8210-056557a3c706 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:45.839299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3d88f4fa-b675-4670-8210-056557a3c706 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:45.842352 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3d88f4fa-b675-4670-8210-056557a3c706 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:45.842352 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3d88f4fa-b675-4670-8210-056557a3c706 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:45.905786 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3d88f4fa-b675-4670-8210-056557a3c706 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:45.913290 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3d88f4fa-b675-4670-8210-056557a3c706 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1143 microversion: 2.1 time: 0.086775 Jul 14 12:27:45.913859 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 550/1082] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:45 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1143 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:46.569501 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e641d183-8515-4f5d-ad61-cdfbe11c333a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:46.570107 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e641d183-8515-4f5d-ad61-cdfbe11c333a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:46.577743 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e641d183-8515-4f5d-ad61-cdfbe11c333a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:46.578736 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e641d183-8515-4f5d-ad61-cdfbe11c333a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:46.579004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e641d183-8515-4f5d-ad61-cdfbe11c333a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:46.579435 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e641d183-8515-4f5d-ad61-cdfbe11c333a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:46.788626 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e641d183-8515-4f5d-ad61-cdfbe11c333a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:46.798513 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e641d183-8515-4f5d-ad61-cdfbe11c333a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1684 microversion: 2.1 time: 0.233109 Jul 14 12:27:46.799130 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 533/1083] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:46 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1684 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:46.932496 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ba724a5f-cf4e-46ec-a701-023aa74707b3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:46.933292 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ba724a5f-cf4e-46ec-a701-023aa74707b3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:46.940393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ba724a5f-cf4e-46ec-a701-023aa74707b3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:46.940936 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ba724a5f-cf4e-46ec-a701-023aa74707b3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:46.941833 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ba724a5f-cf4e-46ec-a701-023aa74707b3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:46.942374 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ba724a5f-cf4e-46ec-a701-023aa74707b3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:47.018233 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ba724a5f-cf4e-46ec-a701-023aa74707b3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:47.027090 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ba724a5f-cf4e-46ec-a701-023aa74707b3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1199 microversion: 2.1 time: 0.099782 Jul 14 12:27:47.027685 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 551/1084] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:46 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:47.389117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-2e7e9d1f-68c8-4b4a-b3b9-73a9420ad24a req-5bdd3a18-98c9-43e0-9fb7-4e48928b9920 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68b91abb-69ba-44ce-af93-7223f9377f04", "name": "network-vif-deleted", "tag": "02899756-e0cb-4d18-b33a-eb06282eef53"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:27:47.400563 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-2e7e9d1f-68c8-4b4a-b3b9-73a9420ad24a req-5bdd3a18-98c9-43e0-9fb7-4e48928b9920 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:47.401178 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-2e7e9d1f-68c8-4b4a-b3b9-73a9420ad24a req-5bdd3a18-98c9-43e0-9fb7-4e48928b9920 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:47.413387 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-2e7e9d1f-68c8-4b4a-b3b9-73a9420ad24a req-5bdd3a18-98c9-43e0-9fb7-4e48928b9920 service nova] Creating event network-vif-deleted:02899756-e0cb-4d18-b33a-eb06282eef53 for instance 68b91abb-69ba-44ce-af93-7223f9377f04 on hv-cinder-84890 Jul 14 12:27:47.420096 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-2e7e9d1f-68c8-4b4a-b3b9-73a9420ad24a req-5bdd3a18-98c9-43e0-9fb7-4e48928b9920 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042401 Jul 14 12:27:47.421106 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 534/1085] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:27:47.816669 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:47.817598 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:47.839861 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:47.855030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:47.855030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:47.855030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:47.888679 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:47.889622 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:47.890254 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lazy-loading 'fault' on Instance uuid 68b91abb-69ba-44ce-af93-7223f9377f04 {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:27:47.942348 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:47.951713 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ce50185e-415b-4be4-a107-e1d68611f147 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 200 len: 1332 microversion: 2.1 time: 0.139019 Jul 14 12:27:47.952228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 552/1086] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:47 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 1332 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:48.045424 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-32152739-5183-414d-9adf-b946ee9b95d1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:48.046120 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-32152739-5183-414d-9adf-b946ee9b95d1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:48.052871 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-32152739-5183-414d-9adf-b946ee9b95d1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:48.053322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-32152739-5183-414d-9adf-b946ee9b95d1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:48.054096 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-32152739-5183-414d-9adf-b946ee9b95d1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:48.054530 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-32152739-5183-414d-9adf-b946ee9b95d1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:48.288910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-32152739-5183-414d-9adf-b946ee9b95d1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:48.304894 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-32152739-5183-414d-9adf-b946ee9b95d1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1277 microversion: 2.1 time: 0.257082 Jul 14 12:27:48.304894 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 535/1087] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:48 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1277 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:48.969329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8bc7abb4-c7a1-4d09-afb3-e1f96bbe1570 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:48.969957 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8bc7abb4-c7a1-4d09-afb3-e1f96bbe1570 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:48.976501 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8bc7abb4-c7a1-4d09-afb3-e1f96bbe1570 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:48.978604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8bc7abb4-c7a1-4d09-afb3-e1f96bbe1570 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:48.978604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8bc7abb4-c7a1-4d09-afb3-e1f96bbe1570 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:48.980230 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8bc7abb4-c7a1-4d09-afb3-e1f96bbe1570 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-8bc7abb4-c7a1-4d09-afb3-e1f96bbe1570 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8bc7abb4-c7a1-4d09-afb3-e1f96bbe1570 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 HTTP/1.1 Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:27:49.001519 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:27:49.003238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '68b91abb-69ba-44ce-af93-7223f9377f04'} Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:27:49.004093 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:27:49.005498 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:49.006812 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8bc7abb4-c7a1-4d09-afb3-e1f96bbe1570 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:27:49.006812 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8bc7abb4-c7a1-4d09-afb3-e1f96bbe1570 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 404 len: 111 microversion: 2.1 time: 0.035723 Jul 14 12:27:49.006812 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 553/1088] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:48 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:27:49.010419 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-32f49b35-699d-4e2a-a60d-9ed9e71dc7c4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '.version_select at 0x7f0e267510d0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:49.090897 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-32f49b35-699d-4e2a-a60d-9ed9e71dc7c4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899658983" status: 202 len: 0 microversion: 2.1 time: 0.084360 Jul 14 12:27:49.104394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 536/1089] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jul 14 12:27:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1899658983 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:27:49.314410 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-cd5178b7-409d-4fee-82dd-e6f1c2ed5352 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:49.315288 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-cd5178b7-409d-4fee-82dd-e6f1c2ed5352 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:49.326613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cd5178b7-409d-4fee-82dd-e6f1c2ed5352 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:49.329235 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cd5178b7-409d-4fee-82dd-e6f1c2ed5352 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:49.330050 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cd5178b7-409d-4fee-82dd-e6f1c2ed5352 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:49.330492 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-cd5178b7-409d-4fee-82dd-e6f1c2ed5352 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:49.493224 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-cd5178b7-409d-4fee-82dd-e6f1c2ed5352 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:49.500901 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-cd5178b7-409d-4fee-82dd-e6f1c2ed5352 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.190233 Jul 14 12:27:49.502797 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 554/1090] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:49 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:49.554551 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-a15f4ae5-0e52-4f95-9e38-dfed596050e8 req-06d0b340-9431-4f4c-9272-08dfe331fa95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7a5743-ed34-4140-b8e4-8cffa12d445e", "tag": "252f163a-d3e9-43b6-852d-55c257c784e1"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:27:49.566673 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-a15f4ae5-0e52-4f95-9e38-dfed596050e8 req-06d0b340-9431-4f4c-9272-08dfe331fa95 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:49.567304 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-a15f4ae5-0e52-4f95-9e38-dfed596050e8 req-06d0b340-9431-4f4c-9272-08dfe331fa95 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:49.578158 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-a15f4ae5-0e52-4f95-9e38-dfed596050e8 req-06d0b340-9431-4f4c-9272-08dfe331fa95 service nova] Creating event network-changed:252f163a-d3e9-43b6-852d-55c257c784e1 for instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e on hv-cinder-84890 Jul 14 12:27:49.584703 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-a15f4ae5-0e52-4f95-9e38-dfed596050e8 req-06d0b340-9431-4f4c-9272-08dfe331fa95 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033945 Jul 14 12:27:49.586241 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 537/1091] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:27:50.301701 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2fa84f40-0d84-4a18-aa06-0578e62be825 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:50.302267 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2fa84f40-0d84-4a18-aa06-0578e62be825 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:50.308677 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2fa84f40-0d84-4a18-aa06-0578e62be825 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:50.309123 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2fa84f40-0d84-4a18-aa06-0578e62be825 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:50.309881 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2fa84f40-0d84-4a18-aa06-0578e62be825 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:50.310312 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2fa84f40-0d84-4a18-aa06-0578e62be825 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:50.392393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-2fa84f40-0d84-4a18-aa06-0578e62be825 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lazy-loading 'services' on Instance uuid b11f46c7-a881-4c33-a4b7-96933eebcf57 {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:27:50.519898 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-707f971d-ee26-4ac5-95fc-3d215e72db77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:50.520585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-707f971d-ee26-4ac5-95fc-3d215e72db77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:50.527586 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-707f971d-ee26-4ac5-95fc-3d215e72db77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:50.531047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-707f971d-ee26-4ac5-95fc-3d215e72db77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:50.531047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-707f971d-ee26-4ac5-95fc-3d215e72db77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:50.531047 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-707f971d-ee26-4ac5-95fc-3d215e72db77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:50.660295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2fa84f40-0d84-4a18-aa06-0578e62be825 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-volume_attachments/1a481a6e-eb51-4cad-bf69-3da4e728b757" status: 202 len: 0 microversion: 2.1 time: 0.362241 Jul 14 12:27:50.661038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 555/1092] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:27:50 2022] DELETE /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-volume_attachments/1a481a6e-eb51-4cad-bf69-3da4e728b757 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:27:50.671505 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e5f28bc0-1f44-4f78-8859-f057d7a51fce tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:50.672466 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e5f28bc0-1f44-4f78-8859-f057d7a51fce tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:50.677898 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-707f971d-ee26-4ac5-95fc-3d215e72db77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:50.679982 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e5f28bc0-1f44-4f78-8859-f057d7a51fce tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:50.681150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e5f28bc0-1f44-4f78-8859-f057d7a51fce tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:50.682165 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e5f28bc0-1f44-4f78-8859-f057d7a51fce tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:50.682606 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e5f28bc0-1f44-4f78-8859-f057d7a51fce tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:50.686204 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-707f971d-ee26-4ac5-95fc-3d215e72db77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.171010 Jul 14 12:27:50.686845 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 538/1093] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:50 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:27:50.701269 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:27:50.714569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e5f28bc0-1f44-4f78-8859-f057d7a51fce tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048865 Jul 14 12:27:50.715159 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 556/1094] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:27:50 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:27:51.703141 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c6f6b891-4e86-4b0d-9dde-f154cb10a547 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:51.703866 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c6f6b891-4e86-4b0d-9dde-f154cb10a547 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:51.710438 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c6f6b891-4e86-4b0d-9dde-f154cb10a547 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:51.710928 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c6f6b891-4e86-4b0d-9dde-f154cb10a547 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:51.712195 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c6f6b891-4e86-4b0d-9dde-f154cb10a547 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:51.712739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c6f6b891-4e86-4b0d-9dde-f154cb10a547 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:51.726259 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-63f594fa-aaa4-47fa-8b7f-26aac14d4042 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:51.727941 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-63f594fa-aaa4-47fa-8b7f-26aac14d4042 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:51.735386 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-63f594fa-aaa4-47fa-8b7f-26aac14d4042 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:51.735829 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-63f594fa-aaa4-47fa-8b7f-26aac14d4042 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:51.736743 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-63f594fa-aaa4-47fa-8b7f-26aac14d4042 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:51.737228 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-63f594fa-aaa4-47fa-8b7f-26aac14d4042 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:51.767145 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-63f594fa-aaa4-47fa-8b7f-26aac14d4042 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044677 Jul 14 12:27:51.767700 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 557/1095] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:27:51 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:27:51.847570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c6f6b891-4e86-4b0d-9dde-f154cb10a547 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:51.855114 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c6f6b891-4e86-4b0d-9dde-f154cb10a547 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.155928 Jul 14 12:27:51.855676 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 539/1096] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:51 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:52.779456 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f961260a-0199-4c15-953f-cdf3b57a5826 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:52.780380 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f961260a-0199-4c15-953f-cdf3b57a5826 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:52.786906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f961260a-0199-4c15-953f-cdf3b57a5826 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:52.787479 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f961260a-0199-4c15-953f-cdf3b57a5826 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:52.788188 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f961260a-0199-4c15-953f-cdf3b57a5826 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:52.788628 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f961260a-0199-4c15-953f-cdf3b57a5826 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:52.818053 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f961260a-0199-4c15-953f-cdf3b57a5826 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043068 Jul 14 12:27:52.818608 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 558/1097] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:27:52 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 12:27:52.872948 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2de75047-ec71-4cc1-8e68-bafc0f025c66 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:52.873757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2de75047-ec71-4cc1-8e68-bafc0f025c66 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:52.875869 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-62d4aeb4-b402-4810-b80d-9a2fa4a4b610 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:52.876365 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-62d4aeb4-b402-4810-b80d-9a2fa4a4b610 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:52.880499 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2de75047-ec71-4cc1-8e68-bafc0f025c66 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:52.880954 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2de75047-ec71-4cc1-8e68-bafc0f025c66 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:52.881723 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2de75047-ec71-4cc1-8e68-bafc0f025c66 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:52.882164 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2de75047-ec71-4cc1-8e68-bafc0f025c66 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:52.882375 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-62d4aeb4-b402-4810-b80d-9a2fa4a4b610 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:52.882856 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-62d4aeb4-b402-4810-b80d-9a2fa4a4b610 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:52.883778 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-62d4aeb4-b402-4810-b80d-9a2fa4a4b610 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:52.884154 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-62d4aeb4-b402-4810-b80d-9a2fa4a4b610 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:52.908370 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-62d4aeb4-b402-4810-b80d-9a2fa4a4b610 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:27:53.013383 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2de75047-ec71-4cc1-8e68-bafc0f025c66 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:53.020803 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2de75047-ec71-4cc1-8e68-bafc0f025c66 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.151792 Jul 14 12:27:53.021348 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 540/1098] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:52 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:53.252711 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-62d4aeb4-b402-4810-b80d-9a2fa4a4b610 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 204 len: 0 microversion: 2.1 time: 0.380334 Jul 14 12:27:53.253304 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 559/1099] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:27:52 2022] DELETE /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 12:27:53.263301 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b6f78673-e879-4283-92d6-af93e12982c0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:53.263301 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b6f78673-e879-4283-92d6-af93e12982c0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:53.268134 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b6f78673-e879-4283-92d6-af93e12982c0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:53.268580 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b6f78673-e879-4283-92d6-af93e12982c0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:53.269338 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b6f78673-e879-4283-92d6-af93e12982c0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:53.269773 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b6f78673-e879-4283-92d6-af93e12982c0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:53.403138 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b6f78673-e879-4283-92d6-af93e12982c0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:53.410480 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b6f78673-e879-4283-92d6-af93e12982c0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1680 microversion: 2.1 time: 0.153006 Jul 14 12:27:53.411090 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 541/1100] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:53 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:54.038080 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b1d0b6d7-88ad-4ed9-a502-e31bf188b1ed tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:54.038696 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b1d0b6d7-88ad-4ed9-a502-e31bf188b1ed tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:54.046102 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b1d0b6d7-88ad-4ed9-a502-e31bf188b1ed tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:54.046555 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b1d0b6d7-88ad-4ed9-a502-e31bf188b1ed tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:54.047351 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b1d0b6d7-88ad-4ed9-a502-e31bf188b1ed tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:54.047789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b1d0b6d7-88ad-4ed9-a502-e31bf188b1ed tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:54.182741 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b1d0b6d7-88ad-4ed9-a502-e31bf188b1ed tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:54.190189 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b1d0b6d7-88ad-4ed9-a502-e31bf188b1ed tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.156409 Jul 14 12:27:54.190749 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 560/1101] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:54 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:27:54.428038 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8d2451c6-bf49-4869-8bce-b50f55ccaabc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:54.428572 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8d2451c6-bf49-4869-8bce-b50f55ccaabc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:54.431748 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:27:54.432471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=6 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:27:54.437475 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d2451c6-bf49-4869-8bce-b50f55ccaabc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:54.437959 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d2451c6-bf49-4869-8bce-b50f55ccaabc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:54.438723 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d2451c6-bf49-4869-8bce-b50f55ccaabc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:54.439185 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8d2451c6-bf49-4869-8bce-b50f55ccaabc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:54.569747 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8d2451c6-bf49-4869-8bce-b50f55ccaabc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:54.577438 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8d2451c6-bf49-4869-8bce-b50f55ccaabc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1680 microversion: 2.1 time: 0.153312 Jul 14 12:27:54.578004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 542/1102] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:54 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:55.207029 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-368188d5-e497-43af-b6a0-b8e27ac21a52 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:55.207652 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-368188d5-e497-43af-b6a0-b8e27ac21a52 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:55.209651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:27:55.215079 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-368188d5-e497-43af-b6a0-b8e27ac21a52 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:55.215533 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-368188d5-e497-43af-b6a0-b8e27ac21a52 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:55.216307 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-368188d5-e497-43af-b6a0-b8e27ac21a52 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:55.216744 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-368188d5-e497-43af-b6a0-b8e27ac21a52 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:55.351115 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-368188d5-e497-43af-b6a0-b8e27ac21a52 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:55.359124 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-368188d5-e497-43af-b6a0-b8e27ac21a52 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.155935 Jul 14 12:27:55.359703 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 561/1103] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:55 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:55.596029 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-172cfc6f-9ac2-43ab-a668-45e08e6cdd8d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:55.596644 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-172cfc6f-9ac2-43ab-a668-45e08e6cdd8d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:55.603824 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-172cfc6f-9ac2-43ab-a668-45e08e6cdd8d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:55.604268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-172cfc6f-9ac2-43ab-a668-45e08e6cdd8d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:55.605034 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-172cfc6f-9ac2-43ab-a668-45e08e6cdd8d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:55.605467 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-172cfc6f-9ac2-43ab-a668-45e08e6cdd8d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:55.775841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-172cfc6f-9ac2-43ab-a668-45e08e6cdd8d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:55.783256 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-172cfc6f-9ac2-43ab-a668-45e08e6cdd8d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1680 microversion: 2.1 time: 0.191224 Jul 14 12:27:55.785810 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 543/1104] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:55 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1680 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:56.101084 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-bafb660a-c0cb-4205-9182-2c9eeb941b99 req-ca15aaac-4907-473a-87b1-2aa026ba9cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b11f46c7-a881-4c33-a4b7-96933eebcf57", "name": "network-vif-deleted", "tag": "44491564-6962-4103-ad53-cbf800a11b21"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:27:56.110214 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-bafb660a-c0cb-4205-9182-2c9eeb941b99 req-ca15aaac-4907-473a-87b1-2aa026ba9cbb service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:56.110652 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-bafb660a-c0cb-4205-9182-2c9eeb941b99 req-ca15aaac-4907-473a-87b1-2aa026ba9cbb service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:56.121598 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-bafb660a-c0cb-4205-9182-2c9eeb941b99 req-ca15aaac-4907-473a-87b1-2aa026ba9cbb service nova] Creating event network-vif-deleted:44491564-6962-4103-ad53-cbf800a11b21 for instance b11f46c7-a881-4c33-a4b7-96933eebcf57 on hv-cinder-84890 Jul 14 12:27:56.126608 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-bafb660a-c0cb-4205-9182-2c9eeb941b99 req-ca15aaac-4907-473a-87b1-2aa026ba9cbb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031891 Jul 14 12:27:56.127262 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 562/1105] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:27:56.376330 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a701c725-897f-453a-94b5-64145f971a25 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:56.376948 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a701c725-897f-453a-94b5-64145f971a25 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:56.383564 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a701c725-897f-453a-94b5-64145f971a25 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:56.384196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a701c725-897f-453a-94b5-64145f971a25 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:56.384966 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a701c725-897f-453a-94b5-64145f971a25 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:56.385408 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a701c725-897f-453a-94b5-64145f971a25 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:56.518660 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a701c725-897f-453a-94b5-64145f971a25 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:56.526938 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a701c725-897f-453a-94b5-64145f971a25 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.154535 Jul 14 12:27:56.527587 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 544/1106] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:56 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:56.800822 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a8a09b48-3695-4fbf-b5a9-f7cd13357dc9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:56.801517 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a8a09b48-3695-4fbf-b5a9-f7cd13357dc9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:56.808936 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a8a09b48-3695-4fbf-b5a9-f7cd13357dc9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:56.810203 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a8a09b48-3695-4fbf-b5a9-f7cd13357dc9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:56.810203 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a8a09b48-3695-4fbf-b5a9-f7cd13357dc9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:56.810616 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a8a09b48-3695-4fbf-b5a9-f7cd13357dc9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:56.873535 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a8a09b48-3695-4fbf-b5a9-f7cd13357dc9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:56.881649 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a8a09b48-3695-4fbf-b5a9-f7cd13357dc9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 200 len: 1326 microversion: 2.1 time: 0.084977 Jul 14 12:27:56.882246 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 563/1107] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:56 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:57.544275 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-09bdca05-c092-40a4-aa9a-8c9273469e2b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:57.544895 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-09bdca05-c092-40a4-aa9a-8c9273469e2b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:57.551570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-09bdca05-c092-40a4-aa9a-8c9273469e2b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:57.552018 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-09bdca05-c092-40a4-aa9a-8c9273469e2b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:57.552791 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-09bdca05-c092-40a4-aa9a-8c9273469e2b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:57.553222 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-09bdca05-c092-40a4-aa9a-8c9273469e2b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:57.690987 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-09bdca05-c092-40a4-aa9a-8c9273469e2b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:57.699703 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-09bdca05-c092-40a4-aa9a-8c9273469e2b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.159544 Jul 14 12:27:57.700537 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 545/1108] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:57 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:57.899110 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2c1fc45f-ee66-4f7f-94ea-874f0dc73fab tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:57.899674 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2c1fc45f-ee66-4f7f-94ea-874f0dc73fab tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:57.906107 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2c1fc45f-ee66-4f7f-94ea-874f0dc73fab tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:57.906562 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2c1fc45f-ee66-4f7f-94ea-874f0dc73fab tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:57.907357 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2c1fc45f-ee66-4f7f-94ea-874f0dc73fab tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:57.907789 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2c1fc45f-ee66-4f7f-94ea-874f0dc73fab tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:57.921804 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-2c1fc45f-ee66-4f7f-94ea-874f0dc73fab tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2c1fc45f-ee66-4f7f-94ea-874f0dc73fab tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 HTTP/1.1 Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:27:57.923484 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:27:57.925075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'b11f46c7-a881-4c33-a4b7-96933eebcf57'} Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:27:57.926037 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:27:57.927345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:27:57.928526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2c1fc45f-ee66-4f7f-94ea-874f0dc73fab tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:27:57.928526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2c1fc45f-ee66-4f7f-94ea-874f0dc73fab tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 404 len: 111 microversion: 2.1 time: 0.029830 Jul 14 12:27:57.928526 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 564/1109] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:57 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:27:57.934952 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-822b0e6a-7a32-47b8-b28b-c22392651e75 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '.version_select at 0x7f0e267513a0>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:58.009715 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-822b0e6a-7a32-47b8-b28b-c22392651e75 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-958647737" status: 202 len: 0 microversion: 2.1 time: 0.079469 Jul 14 12:27:58.010377 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 546/1110] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jul 14 12:27:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-958647737 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:27:58.717899 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5febd7ce-8da1-44d7-b5ab-33bc1d6d0bf7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:58.718724 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5febd7ce-8da1-44d7-b5ab-33bc1d6d0bf7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:58.725538 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5febd7ce-8da1-44d7-b5ab-33bc1d6d0bf7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:58.726049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5febd7ce-8da1-44d7-b5ab-33bc1d6d0bf7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:58.727111 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5febd7ce-8da1-44d7-b5ab-33bc1d6d0bf7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:58.727896 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5febd7ce-8da1-44d7-b5ab-33bc1d6d0bf7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:58.762399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c3b69d0a-9f4c-446d-b071-a8b56c044d63 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: .version_select at 0x7f0e2677a8b0>, body: {"keypair": {"name": "tempest-keypair-715647815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIK6y94DqOaIf78qK43zAvddKfXYuIGAADxATdeVnZARO+Cy95A5nH7j/D1P2AkHI8aVjoAZT0vlA5hc003hrs0I8uhT3LGdXMr9lemawjr6cM9R45g9vBASjJ9jfYUfww=="}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:27:58.779406 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-c3b69d0a-9f4c-446d-b071-a8b56c044d63 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:27:58.783537 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-c3b69d0a-9f4c-446d-b071-a8b56c044d63 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for user 8d824401d1454a2bb19d7628e38b256a and project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'key_pairs'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:27:58.870705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5febd7ce-8da1-44d7-b5ab-33bc1d6d0bf7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:27:58.878216 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5febd7ce-8da1-44d7-b5ab-33bc1d6d0bf7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.164741 Jul 14 12:27:58.878699 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 565/1111] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:58 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:27:58.878845 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c3b69d0a-9f4c-446d-b071-a8b56c044d63 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120838 Jul 14 12:27:58.879484 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 547/1112] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 12:27:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:27:59.010490 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-bc63f84e-5374-456f-9a40-cd4bcd18a43a req-d8a1dcda-91b1-4c98-92d9-948441dbfaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7a5743-ed34-4140-b8e4-8cffa12d445e", "name": "network-vif-plugged", "status": "completed", "tag": "252f163a-d3e9-43b6-852d-55c257c784e1"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:27:59.020468 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-bc63f84e-5374-456f-9a40-cd4bcd18a43a req-d8a1dcda-91b1-4c98-92d9-948441dbfaf7 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:59.020980 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-bc63f84e-5374-456f-9a40-cd4bcd18a43a req-d8a1dcda-91b1-4c98-92d9-948441dbfaf7 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:59.032237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-bc63f84e-5374-456f-9a40-cd4bcd18a43a req-d8a1dcda-91b1-4c98-92d9-948441dbfaf7 service nova] Creating event network-vif-plugged:252f163a-d3e9-43b6-852d-55c257c784e1 for instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e on hv-cinder-84890 Jul 14 12:27:59.037023 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-bc63f84e-5374-456f-9a40-cd4bcd18a43a req-d8a1dcda-91b1-4c98-92d9-948441dbfaf7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031119 Jul 14 12:27:59.037832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 566/1113] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:27:59.902210 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7721b5df-7c4f-47b8-a51c-0181bdeffc60 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:27:59.903048 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7721b5df-7c4f-47b8-a51c-0181bdeffc60 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:27:59.909866 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7721b5df-7c4f-47b8-a51c-0181bdeffc60 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:59.910312 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7721b5df-7c4f-47b8-a51c-0181bdeffc60 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:27:59.911111 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7721b5df-7c4f-47b8-a51c-0181bdeffc60 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:27:59.911550 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7721b5df-7c4f-47b8-a51c-0181bdeffc60 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:00.043502 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7721b5df-7c4f-47b8-a51c-0181bdeffc60 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:00.051027 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7721b5df-7c4f-47b8-a51c-0181bdeffc60 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.153140 Jul 14 12:28:00.051597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 548/1114] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:27:59 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:01.070750 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e29bb0d1-c259-4c2b-9fa5-c4a52c23e65b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:01.071496 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e29bb0d1-c259-4c2b-9fa5-c4a52c23e65b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:01.079414 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e29bb0d1-c259-4c2b-9fa5-c4a52c23e65b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:01.079414 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e29bb0d1-c259-4c2b-9fa5-c4a52c23e65b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:01.079414 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e29bb0d1-c259-4c2b-9fa5-c4a52c23e65b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:01.079414 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e29bb0d1-c259-4c2b-9fa5-c4a52c23e65b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:01.235829 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e29bb0d1-c259-4c2b-9fa5-c4a52c23e65b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:01.243763 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e29bb0d1-c259-4c2b-9fa5-c4a52c23e65b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1265 microversion: 2.1 time: 0.178304 Jul 14 12:28:01.244338 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 567/1115] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:01 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:01.353087 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-886506718", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "738fa312-d388-4da8-be3f-aad30d233548"}], "security_groups": [{"name": "tempest-securitygroup--656355647"}], "key_name": "tempest-keypair-715647815", "user_data": "}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:28:01.457306 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] validate_networks() for [('738fa312-d388-4da8-be3f-aad30d233548', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:28:02.065334 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:28:02.065754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:28:02.066222 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:28:02.066682 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:28:02.067178 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:28:02.076664 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:02.077290 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:02.078004 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:02.078440 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:02.084971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=100 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:28:02.095352 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:28:02.099357 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for user 8d824401d1454a2bb19d7628e38b256a and project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:28:02.110951 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:28:02.113262 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:28:02.261729 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6f68e6a1-a593-4e79-bf9b-170cc396aa77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:02.262475 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6f68e6a1-a593-4e79-bf9b-170cc396aa77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:02.268560 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e35febb9-202c-4b6e-995c-0c64f277275a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.920073 Jul 14 12:28:02.274499 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 549/1116] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:28:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:28:02.274647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6f68e6a1-a593-4e79-bf9b-170cc396aa77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:02.274647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6f68e6a1-a593-4e79-bf9b-170cc396aa77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:02.274647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6f68e6a1-a593-4e79-bf9b-170cc396aa77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:02.274647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6f68e6a1-a593-4e79-bf9b-170cc396aa77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:02.279412 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b03d5479-6600-4136-ac44-fe4e7ad6e1a6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:02.280158 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b03d5479-6600-4136-ac44-fe4e7ad6e1a6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:02.347520 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-b03d5479-6600-4136-ac44-fe4e7ad6e1a6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:02.355613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b03d5479-6600-4136-ac44-fe4e7ad6e1a6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1240 microversion: 2.1 time: 0.080017 Jul 14 12:28:02.356531 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 550/1117] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:02 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:02.413072 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6f68e6a1-a593-4e79-bf9b-170cc396aa77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:02.422151 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6f68e6a1-a593-4e79-bf9b-170cc396aa77 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1452 microversion: 2.1 time: 0.165087 Jul 14 12:28:02.422825 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 568/1118] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:02 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:28:02.437976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-fd4dc94b-3fb5-4a00-bcac-4a7f424dfa64 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:02.438608 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-fd4dc94b-3fb5-4a00-bcac-4a7f424dfa64 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:02.445552 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fd4dc94b-3fb5-4a00-bcac-4a7f424dfa64 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:02.446006 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fd4dc94b-3fb5-4a00-bcac-4a7f424dfa64 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:02.446792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fd4dc94b-3fb5-4a00-bcac-4a7f424dfa64 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:02.447249 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-fd4dc94b-3fb5-4a00-bcac-4a7f424dfa64 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:02.578446 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-fd4dc94b-3fb5-4a00-bcac-4a7f424dfa64 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:02.586357 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-fd4dc94b-3fb5-4a00-bcac-4a7f424dfa64 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1452 microversion: 2.1 time: 0.152024 Jul 14 12:28:02.586937 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 551/1119] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:02 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1452 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:03.373390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-48d005c3-8d24-41b6-a531-1433c114dff1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:03.373967 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-48d005c3-8d24-41b6-a531-1433c114dff1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:03.380630 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-48d005c3-8d24-41b6-a531-1433c114dff1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:03.381082 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-48d005c3-8d24-41b6-a531-1433c114dff1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:03.381862 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-48d005c3-8d24-41b6-a531-1433c114dff1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:03.382492 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-48d005c3-8d24-41b6-a531-1433c114dff1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:03.446177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-48d005c3-8d24-41b6-a531-1433c114dff1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:03.453687 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-48d005c3-8d24-41b6-a531-1433c114dff1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1244 microversion: 2.1 time: 0.084408 Jul 14 12:28:03.454299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 569/1120] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:03 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:04.471290 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-3fc91511-584c-442b-a5c5-6116ce331eec tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:04.471893 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-3fc91511-584c-442b-a5c5-6116ce331eec tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:04.475344 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:DELETE=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:28:04.479813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3fc91511-584c-442b-a5c5-6116ce331eec tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:04.480261 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3fc91511-584c-442b-a5c5-6116ce331eec tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:04.481041 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3fc91511-584c-442b-a5c5-6116ce331eec tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:04.481478 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-3fc91511-584c-442b-a5c5-6116ce331eec tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:04.570745 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-3fc91511-584c-442b-a5c5-6116ce331eec tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:04.578817 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-3fc91511-584c-442b-a5c5-6116ce331eec tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1300 microversion: 2.1 time: 0.111490 Jul 14 12:28:04.579542 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 552/1121] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:04 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:04.767746 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-dc724d02-f9f4-4cae-9be7-2add070c8944 req-0e36be0b-2b05-4f6b-840c-47cf2c40afd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7a5743-ed34-4140-b8e4-8cffa12d445e", "tag": "252f163a-d3e9-43b6-852d-55c257c784e1"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:28:04.777643 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-dc724d02-f9f4-4cae-9be7-2add070c8944 req-0e36be0b-2b05-4f6b-840c-47cf2c40afd1 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:04.778389 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-dc724d02-f9f4-4cae-9be7-2add070c8944 req-0e36be0b-2b05-4f6b-840c-47cf2c40afd1 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:04.790369 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-dc724d02-f9f4-4cae-9be7-2add070c8944 req-0e36be0b-2b05-4f6b-840c-47cf2c40afd1 service nova] Creating event network-changed:252f163a-d3e9-43b6-852d-55c257c784e1 for instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e on hv-cinder-84890 Jul 14 12:28:04.796160 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-dc724d02-f9f4-4cae-9be7-2add070c8944 req-0e36be0b-2b05-4f6b-840c-47cf2c40afd1 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032951 Jul 14 12:28:04.797030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 570/1122] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:28:05.601973 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-422593e0-4382-4570-8e39-75abf5754f1b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:05.602799 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-422593e0-4382-4570-8e39-75abf5754f1b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:05.615134 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-422593e0-4382-4570-8e39-75abf5754f1b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:05.615881 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-422593e0-4382-4570-8e39-75abf5754f1b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:05.616937 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-422593e0-4382-4570-8e39-75abf5754f1b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:05.617600 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-422593e0-4382-4570-8e39-75abf5754f1b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:05.847657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-422593e0-4382-4570-8e39-75abf5754f1b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:05.855887 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-422593e0-4382-4570-8e39-75abf5754f1b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1365 microversion: 2.1 time: 0.257854 Jul 14 12:28:05.856458 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 553/1123] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:05 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:06.873285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-16c12594-a228-4937-b1d9-4204b61afe42 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:06.873908 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-16c12594-a228-4937-b1d9-4204b61afe42 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:06.881046 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-16c12594-a228-4937-b1d9-4204b61afe42 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:06.881502 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-16c12594-a228-4937-b1d9-4204b61afe42 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:06.882282 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-16c12594-a228-4937-b1d9-4204b61afe42 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:06.883238 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-16c12594-a228-4937-b1d9-4204b61afe42 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:06.953977 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-a691a744-cfb1-4abc-82f2-95f18781bc3b req-462b29f7-630c-45f1-8a74-e1f0d52bc5be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6250940e-0393-4bf0-8653-061672eaf7fd", "tag": "21528937-2e91-4664-9111-ff2b0348da0f"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:28:06.963573 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-a691a744-cfb1-4abc-82f2-95f18781bc3b req-462b29f7-630c-45f1-8a74-e1f0d52bc5be service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:06.964020 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-a691a744-cfb1-4abc-82f2-95f18781bc3b req-462b29f7-630c-45f1-8a74-e1f0d52bc5be service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:06.985605 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-a691a744-cfb1-4abc-82f2-95f18781bc3b req-462b29f7-630c-45f1-8a74-e1f0d52bc5be service nova] Creating event network-changed:21528937-2e91-4664-9111-ff2b0348da0f for instance 6250940e-0393-4bf0-8653-061672eaf7fd on hv-cinder-84890 Jul 14 12:28:06.985605 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-a691a744-cfb1-4abc-82f2-95f18781bc3b req-462b29f7-630c-45f1-8a74-e1f0d52bc5be service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034803 Jul 14 12:28:06.988390 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 554/1124] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:28:07.047762 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-16c12594-a228-4937-b1d9-4204b61afe42 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:07.056515 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-16c12594-a228-4937-b1d9-4204b61afe42 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1365 microversion: 2.1 time: 0.187614 Jul 14 12:28:07.057214 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 571/1125] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:06 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1365 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:08.074107 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-57af58bc-acc7-4c24-9c07-65c70425e7c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:08.074864 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-57af58bc-acc7-4c24-9c07-65c70425e7c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:08.081141 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-57af58bc-acc7-4c24-9c07-65c70425e7c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:08.081592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-57af58bc-acc7-4c24-9c07-65c70425e7c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:08.082365 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-57af58bc-acc7-4c24-9c07-65c70425e7c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:08.082831 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-57af58bc-acc7-4c24-9c07-65c70425e7c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:08.212427 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-57af58bc-acc7-4c24-9c07-65c70425e7c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:08.219739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-57af58bc-acc7-4c24-9c07-65c70425e7c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1365 microversion: 2.1 time: 0.150362 Jul 14 12:28:08.220293 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 555/1126] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:08 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:09.236903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-584f6d3a-ea8d-4705-b19f-99043fc701fd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:09.237696 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-584f6d3a-ea8d-4705-b19f-99043fc701fd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:09.240302 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:28:09.245868 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-584f6d3a-ea8d-4705-b19f-99043fc701fd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:09.246322 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-584f6d3a-ea8d-4705-b19f-99043fc701fd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:09.249255 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-584f6d3a-ea8d-4705-b19f-99043fc701fd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:09.249255 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-584f6d3a-ea8d-4705-b19f-99043fc701fd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:09.379422 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-584f6d3a-ea8d-4705-b19f-99043fc701fd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:09.387141 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-584f6d3a-ea8d-4705-b19f-99043fc701fd tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1365 microversion: 2.1 time: 0.154213 Jul 14 12:28:09.387712 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 572/1127] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:09 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 12:28:10.404100 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-372706e5-aa25-4811-ad5c-f41a7c476ab0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:10.404621 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-372706e5-aa25-4811-ad5c-f41a7c476ab0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:10.411329 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-372706e5-aa25-4811-ad5c-f41a7c476ab0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:10.411779 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-372706e5-aa25-4811-ad5c-f41a7c476ab0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:10.412550 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-372706e5-aa25-4811-ad5c-f41a7c476ab0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:10.412983 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-372706e5-aa25-4811-ad5c-f41a7c476ab0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:10.537633 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-372706e5-aa25-4811-ad5c-f41a7c476ab0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:10.545955 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-372706e5-aa25-4811-ad5c-f41a7c476ab0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1365 microversion: 2.1 time: 0.145736 Jul 14 12:28:10.546526 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 556/1128] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:10 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:11.043951 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-69a87595-bb8b-4cba-975d-4ca778c1f4ed req-49589e70-ca34-4d96-a216-41340154a81a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6250940e-0393-4bf0-8653-061672eaf7fd", "name": "network-vif-plugged", "status": "completed", "tag": "21528937-2e91-4664-9111-ff2b0348da0f"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:28:11.052378 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-69a87595-bb8b-4cba-975d-4ca778c1f4ed req-49589e70-ca34-4d96-a216-41340154a81a service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:11.058661 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-69a87595-bb8b-4cba-975d-4ca778c1f4ed req-49589e70-ca34-4d96-a216-41340154a81a service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:11.063792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-69a87595-bb8b-4cba-975d-4ca778c1f4ed req-49589e70-ca34-4d96-a216-41340154a81a service nova] Creating event network-vif-plugged:21528937-2e91-4664-9111-ff2b0348da0f for instance 6250940e-0393-4bf0-8653-061672eaf7fd on hv-cinder-84890 Jul 14 12:28:11.068490 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-69a87595-bb8b-4cba-975d-4ca778c1f4ed req-49589e70-ca34-4d96-a216-41340154a81a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028514 Jul 14 12:28:11.069144 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 573/1129] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:28:11.563519 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-65655591-03a7-44eb-94a2-903d95c04a38 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:11.564137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-65655591-03a7-44eb-94a2-903d95c04a38 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:11.571283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-65655591-03a7-44eb-94a2-903d95c04a38 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:11.571725 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-65655591-03a7-44eb-94a2-903d95c04a38 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:11.572495 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-65655591-03a7-44eb-94a2-903d95c04a38 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:11.572941 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-65655591-03a7-44eb-94a2-903d95c04a38 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:11.705399 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-65655591-03a7-44eb-94a2-903d95c04a38 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:11.713117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-65655591-03a7-44eb-94a2-903d95c04a38 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1365 microversion: 2.1 time: 0.153430 Jul 14 12:28:11.713691 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 557/1130] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:11 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:12.731493 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-3f02672b-62de-46a5-b6f5-cc9eff229632 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:12.732195 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-3f02672b-62de-46a5-b6f5-cc9eff229632 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:12.738583 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f02672b-62de-46a5-b6f5-cc9eff229632 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:12.739068 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f02672b-62de-46a5-b6f5-cc9eff229632 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:12.739832 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f02672b-62de-46a5-b6f5-cc9eff229632 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:12.740266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-3f02672b-62de-46a5-b6f5-cc9eff229632 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:12.876469 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-3f02672b-62de-46a5-b6f5-cc9eff229632 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:28:12.880075 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:28:12.885251 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-3f02672b-62de-46a5-b6f5-cc9eff229632 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1556 microversion: 2.1 time: 0.159258 Jul 14 12:28:12.885819 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 574/1131] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:28:12 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:28:12.902238 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-59ec0d9b-8b6c-4a8e-a85c-1861e8714aae tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:12.902760 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-59ec0d9b-8b6c-4a8e-a85c-1861e8714aae tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:12.904804 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:28:12.905491 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=12 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:28:12.910873 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-59ec0d9b-8b6c-4a8e-a85c-1861e8714aae tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:12.911328 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-59ec0d9b-8b6c-4a8e-a85c-1861e8714aae tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:12.912867 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-59ec0d9b-8b6c-4a8e-a85c-1861e8714aae tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:12.912867 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-59ec0d9b-8b6c-4a8e-a85c-1861e8714aae tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:12.994902 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-59ec0d9b-8b6c-4a8e-a85c-1861e8714aae tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097293 Jul 14 12:28:12.995499 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 558/1132] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 12:28:12 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:28:13.980710 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-4e3dde2f-a9bd-41ce-a53f-7122249d9250 req-6e5520ff-d08e-460a-9556-af6c870e34da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6250940e-0393-4bf0-8653-061672eaf7fd", "tag": "21528937-2e91-4664-9111-ff2b0348da0f"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:28:13.989840 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-4e3dde2f-a9bd-41ce-a53f-7122249d9250 req-6e5520ff-d08e-460a-9556-af6c870e34da service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:13.990283 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-4e3dde2f-a9bd-41ce-a53f-7122249d9250 req-6e5520ff-d08e-460a-9556-af6c870e34da service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:14.001710 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-4e3dde2f-a9bd-41ce-a53f-7122249d9250 req-6e5520ff-d08e-460a-9556-af6c870e34da service nova] Creating event network-changed:21528937-2e91-4664-9111-ff2b0348da0f for instance 6250940e-0393-4bf0-8653-061672eaf7fd on hv-cinder-84890 Jul 14 12:28:14.006521 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-4e3dde2f-a9bd-41ce-a53f-7122249d9250 req-6e5520ff-d08e-460a-9556-af6c870e34da service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029835 Jul 14 12:28:14.007805 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 575/1133] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:28:29.611038 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:28:29.611714 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Thu Jul 14 12:28:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:28:57.674555 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=12 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:28:57.675333 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=42 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:28:57.679584 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c0d3c89f-98c5-48a2-af44-a711319c1fb8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:28:57.680067 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c0d3c89f-98c5-48a2-af44-a711319c1fb8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:57.686653 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0d3c89f-98c5-48a2-af44-a711319c1fb8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:57.690037 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0d3c89f-98c5-48a2-af44-a711319c1fb8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:57.690037 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0d3c89f-98c5-48a2-af44-a711319c1fb8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:57.690037 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c0d3c89f-98c5-48a2-af44-a711319c1fb8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:57.712192 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c0d3c89f-98c5-48a2-af44-a711319c1fb8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/ips" status: 200 len: 150 microversion: 2.1 time: 0.039126 Jul 14 12:28:57.712798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 559/1134] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:28:57 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:28:59.229779 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=7 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:28:59.234134 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-98ee8b50-9ab8-45e9-81f1-328675465e72 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "340af0f1-77e3-4fd5-b867-689cfcb33d19"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:28:59.235295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-98ee8b50-9ab8-45e9-81f1-328675465e72 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:28:59.242389 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-98ee8b50-9ab8-45e9-81f1-328675465e72 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:59.243659 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-98ee8b50-9ab8-45e9-81f1-328675465e72 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:28:59.244481 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-98ee8b50-9ab8-45e9-81f1-328675465e72 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:28:59.244925 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-98ee8b50-9ab8-45e9-81f1-328675465e72 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:00.233891 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-98ee8b50-9ab8-45e9-81f1-328675465e72 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.005482 Jul 14 12:29:00.238280 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 576/1135] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:28:59 2022] POST /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments => generated 194 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:29:08.764644 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-df9c9187-b1b7-43c5-b27f-ec1da0e3ab2f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "340af0f1-77e3-4fd5-b867-689cfcb33d19"}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:29:08.765711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-df9c9187-b1b7-43c5-b27f-ec1da0e3ab2f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:08.768404 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:29:08.773401 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-df9c9187-b1b7-43c5-b27f-ec1da0e3ab2f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:08.773851 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-df9c9187-b1b7-43c5-b27f-ec1da0e3ab2f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:08.774620 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-df9c9187-b1b7-43c5-b27f-ec1da0e3ab2f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:08.775091 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-df9c9187-b1b7-43c5-b27f-ec1da0e3ab2f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:08.902895 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-df9c9187-b1b7-43c5-b27f-ec1da0e3ab2f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Invalid volume: volume 340af0f1-77e3-4fd5-b867-689cfcb33d19 is already attached to instances: 6250940e-0393-4bf0-8653-061672eaf7fd Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-df9c9187-b1b7-43c5-b27f-ec1da0e3ab2f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: POST /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments HTTP/1.1 Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 74 Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:29:08.905597 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {"volumeAttachment": {"volumeId": "340af0f1-77e3-4fd5-b867-689cfcb33d19"}} Jul 14 12:29:08.907322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Invalid volume: volume 340af0f1-77e3-4fd5-b867-689cfcb33d19 is already attached to instances: 6250940e-0393-4bf0-8653-061672eaf7fd Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'server_id': '6250940e-0393-4bf0-8653-061672eaf7fd', 'body': {'volumeAttachment': {'volumeId': '340af0f1-77e3-4fd5-b867-689cfcb33d19'}}} Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 340af0f1-77e3-4fd5-b867-689cfcb33d19 is already attached to instances: 6250940e-0393-4bf0-8653-061672eaf7fd Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:29:08.908311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 340af0f1-77e3-4fd5-b867-689cfcb33d19 is already attached to instances: 6250940e-0393-4bf0-8653-061672eaf7fd Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:29:08.909570 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:29:08.910971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:29:08.910971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:29:08.910971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:29:08.910971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 340af0f1-77e3-4fd5-b867-689cfcb33d19 is already attached to instances: 6250940e-0393-4bf0-8653-061672eaf7fd Jul 14 12:29:08.910971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:29:08.910971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-df9c9187-b1b7-43c5-b27f-ec1da0e3ab2f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 400 to user: Invalid volume: volume 340af0f1-77e3-4fd5-b867-689cfcb33d19 is already attached to instances: 6250940e-0393-4bf0-8653-061672eaf7fd {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:29:08.910971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-df9c9187-b1b7-43c5-b27f-ec1da0e3ab2f tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147146 Jul 14 12:29:08.910971 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 560/1136] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:29:08 2022] POST /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments => generated 174 bytes in 148 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 12:29:08.968780 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-f5a21b8e-e75a-4300-bf83-af5ffe256500 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:08.969355 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-f5a21b8e-e75a-4300-bf83-af5ffe256500 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:08.976447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f5a21b8e-e75a-4300-bf83-af5ffe256500 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:08.976905 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f5a21b8e-e75a-4300-bf83-af5ffe256500 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:08.977669 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f5a21b8e-e75a-4300-bf83-af5ffe256500 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:08.978109 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-f5a21b8e-e75a-4300-bf83-af5ffe256500 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:09.056912 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-f5a21b8e-e75a-4300-bf83-af5ffe256500 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lazy-loading 'services' on Instance uuid 6250940e-0393-4bf0-8653-061672eaf7fd {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:29:09.277634 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-f5a21b8e-e75a-4300-bf83-af5ffe256500 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments/340af0f1-77e3-4fd5-b867-689cfcb33d19" status: 202 len: 0 microversion: 2.1 time: 0.313391 Jul 14 12:29:09.278229 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 577/1137] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:29:08 2022] DELETE /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments/340af0f1-77e3-4fd5-b867-689cfcb33d19 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:29:09.287798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d8f027a2-ad03-49df-87cc-739509e19b94 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:09.289019 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d8f027a2-ad03-49df-87cc-739509e19b94 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:09.297071 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d8f027a2-ad03-49df-87cc-739509e19b94 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:09.297523 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d8f027a2-ad03-49df-87cc-739509e19b94 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:09.298301 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d8f027a2-ad03-49df-87cc-739509e19b94 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:09.298875 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d8f027a2-ad03-49df-87cc-739509e19b94 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:09.328995 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d8f027a2-ad03-49df-87cc-739509e19b94 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045743 Jul 14 12:29:09.329602 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 561/1138] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:29:09 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:29:10.342134 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-46f4136d-4ac0-41d8-97ba-b8257d356cb1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:10.343182 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-46f4136d-4ac0-41d8-97ba-b8257d356cb1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:10.349465 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-46f4136d-4ac0-41d8-97ba-b8257d356cb1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:10.349939 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-46f4136d-4ac0-41d8-97ba-b8257d356cb1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:10.350710 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-46f4136d-4ac0-41d8-97ba-b8257d356cb1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:10.351207 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-46f4136d-4ac0-41d8-97ba-b8257d356cb1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:10.380932 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-46f4136d-4ac0-41d8-97ba-b8257d356cb1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043759 Jul 14 12:29:10.381508 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 578/1139] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:29:10 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:29:11.393334 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-01bb681f-77a3-4be6-9054-84684cf21f0c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:11.394252 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-01bb681f-77a3-4be6-9054-84684cf21f0c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:11.400704 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-01bb681f-77a3-4be6-9054-84684cf21f0c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:11.401156 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-01bb681f-77a3-4be6-9054-84684cf21f0c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:11.401928 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-01bb681f-77a3-4be6-9054-84684cf21f0c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:11.402366 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-01bb681f-77a3-4be6-9054-84684cf21f0c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:11.430668 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-01bb681f-77a3-4be6-9054-84684cf21f0c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041578 Jul 14 12:29:11.431251 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 562/1140] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:29:11 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 12:29:11.488101 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c6ff06a0-d081-43de-84ce-1d82a89ef6d8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:11.488613 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c6ff06a0-d081-43de-84ce-1d82a89ef6d8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:11.495027 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6ff06a0-d081-43de-84ce-1d82a89ef6d8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:11.495506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6ff06a0-d081-43de-84ce-1d82a89ef6d8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:11.496276 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6ff06a0-d081-43de-84ce-1d82a89ef6d8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:11.496717 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c6ff06a0-d081-43de-84ce-1d82a89ef6d8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:11.524285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c6ff06a0-d081-43de-84ce-1d82a89ef6d8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:29:11.829866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c6ff06a0-d081-43de-84ce-1d82a89ef6d8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 204 len: 0 microversion: 2.1 time: 0.345323 Jul 14 12:29:11.830462 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 579/1141] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:29:11 2022] DELETE /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:29:11.838626 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-d0ad5fcf-e4eb-4bb0-b12e-e8c4a764a77c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:11.844027 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-d0ad5fcf-e4eb-4bb0-b12e-e8c4a764a77c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:11.845272 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d0ad5fcf-e4eb-4bb0-b12e-e8c4a764a77c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:11.845728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d0ad5fcf-e4eb-4bb0-b12e-e8c4a764a77c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:11.846490 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d0ad5fcf-e4eb-4bb0-b12e-e8c4a764a77c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:11.846965 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-d0ad5fcf-e4eb-4bb0-b12e-e8c4a764a77c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:11.977037 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-d0ad5fcf-e4eb-4bb0-b12e-e8c4a764a77c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:11.985322 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-d0ad5fcf-e4eb-4bb0-b12e-e8c4a764a77c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1680 microversion: 2.1 time: 0.150580 Jul 14 12:29:11.985891 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 563/1142] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:11 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:13.003474 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-551837e0-823d-4edf-ac34-6e43cdbd1dc3 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:13.004146 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-551837e0-823d-4edf-ac34-6e43cdbd1dc3 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:13.010651 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-551837e0-823d-4edf-ac34-6e43cdbd1dc3 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:13.011137 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-551837e0-823d-4edf-ac34-6e43cdbd1dc3 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:13.011905 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-551837e0-823d-4edf-ac34-6e43cdbd1dc3 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:13.012346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-551837e0-823d-4edf-ac34-6e43cdbd1dc3 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:13.142560 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-551837e0-823d-4edf-ac34-6e43cdbd1dc3 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:13.150125 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-551837e0-823d-4edf-ac34-6e43cdbd1dc3 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1680 microversion: 2.1 time: 0.151007 Jul 14 12:29:13.150687 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 580/1143] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:12 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:14.166739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e90f69f9-1cd8-43a1-92f1-2960051c6d4a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:14.167743 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e90f69f9-1cd8-43a1-92f1-2960051c6d4a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:14.179042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e90f69f9-1cd8-43a1-92f1-2960051c6d4a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:14.179042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e90f69f9-1cd8-43a1-92f1-2960051c6d4a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:14.179042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e90f69f9-1cd8-43a1-92f1-2960051c6d4a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:14.179042 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e90f69f9-1cd8-43a1-92f1-2960051c6d4a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:14.342109 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-e90f69f9-1cd8-43a1-92f1-2960051c6d4a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:14.350009 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e90f69f9-1cd8-43a1-92f1-2960051c6d4a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1680 microversion: 2.1 time: 0.187190 Jul 14 12:29:14.350641 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 564/1144] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:14 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:14.765408 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-07472a2b-28ee-404d-af64-5a70f2a3d0ee req-3094c8fc-a966-41d8-8c35-28cfa2c04f56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6250940e-0393-4bf0-8653-061672eaf7fd", "name": "network-vif-deleted", "tag": "21528937-2e91-4664-9111-ff2b0348da0f"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:29:14.773978 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-07472a2b-28ee-404d-af64-5a70f2a3d0ee req-3094c8fc-a966-41d8-8c35-28cfa2c04f56 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:14.774417 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-07472a2b-28ee-404d-af64-5a70f2a3d0ee req-3094c8fc-a966-41d8-8c35-28cfa2c04f56 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:14.786299 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-07472a2b-28ee-404d-af64-5a70f2a3d0ee req-3094c8fc-a966-41d8-8c35-28cfa2c04f56 service nova] Creating event network-vif-deleted:21528937-2e91-4664-9111-ff2b0348da0f for instance 6250940e-0393-4bf0-8653-061672eaf7fd on hv-cinder-84890 Jul 14 12:29:14.791254 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-07472a2b-28ee-404d-af64-5a70f2a3d0ee req-3094c8fc-a966-41d8-8c35-28cfa2c04f56 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098448 Jul 14 12:29:14.791853 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 581/1145] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:29:15.367641 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:15.368236 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:15.374982 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:15.375429 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:15.376198 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:15.376632 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:15.407608 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:15.408052 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:15.408505 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lazy-loading 'fault' on Instance uuid 6250940e-0393-4bf0-8653-061672eaf7fd {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:29:15.450745 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:15.458891 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-0594cd77-68b7-45e1-8d9b-cc0ccb7831b9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 200 len: 1330 microversion: 2.1 time: 0.095024 Jul 14 12:29:15.459477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 565/1146] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:15 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:16.477509 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ea1c1c79-453e-48fe-9abb-b9301108a98c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:16.478232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ea1c1c79-453e-48fe-9abb-b9301108a98c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:16.485152 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ea1c1c79-453e-48fe-9abb-b9301108a98c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:16.485602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ea1c1c79-453e-48fe-9abb-b9301108a98c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:16.486366 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ea1c1c79-453e-48fe-9abb-b9301108a98c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:16.486836 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ea1c1c79-453e-48fe-9abb-b9301108a98c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:16.500688 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-ea1c1c79-453e-48fe-9abb-b9301108a98c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ea1c1c79-453e-48fe-9abb-b9301108a98c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd HTTP/1.1 Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:29:16.502285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:29:16.504030 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '6250940e-0393-4bf0-8653-061672eaf7fd'} Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:29:16.504873 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:29:16.506231 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:29:16.507442 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ea1c1c79-453e-48fe-9abb-b9301108a98c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:29:16.507442 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ea1c1c79-453e-48fe-9abb-b9301108a98c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 404 len: 111 microversion: 2.1 time: 0.030809 Jul 14 12:29:16.507442 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 582/1147] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:16 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:29:16.512478 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c88174b5-48ec-4753-af2e-f56832352877 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '.version_select at 0x7f0e26873d30>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:16.619184 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c88174b5-48ec-4753-af2e-f56832352877 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-715647815" status: 202 len: 0 microversion: 2.1 time: 0.110312 Jul 14 12:29:16.619763 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 566/1148] 10.222.0.27 () {58 vars in 1217 bytes} [Thu Jul 14 12:29:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-715647815 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:29:17.335259 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2f2a06ff-8cd4-4999-aee6-b587734f2c85 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: .version_select at 0x7f0e263c2670>, body: {"keypair": {"name": "tempest-keypair-1752012855", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHu/v1l2Jh9+H8OzWJex22JE9+kVITkl8OLyAg1rjZ7Nd9ATQaLNZCUrIh90WsRTVqr6gexNfZ3SouESH+Vf2tCdNnPNJF/vdRWS5wYO11c2PUkF2HibFMxtlxQomvRHuQ=="}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:29:17.349381 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-2f2a06ff-8cd4-4999-aee6-b587734f2c85 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'key_pairs'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:29:17.353160 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-2f2a06ff-8cd4-4999-aee6-b587734f2c85 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for user 8d824401d1454a2bb19d7628e38b256a and project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'key_pairs'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:29:17.434013 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2f2a06ff-8cd4-4999-aee6-b587734f2c85 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102661 Jul 14 12:29:17.434617 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 583/1149] 10.222.0.27 () {60 vars in 1158 bytes} [Thu Jul 14 12:29:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:29:19.775661 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1069645275", "imageRef": "f065e937-343c-4647-9849-e13f751971c9", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "738fa312-d388-4da8-be3f-aad30d233548"}], "security_groups": [{"name": "tempest-securitygroup--1793619904"}], "key_name": "tempest-keypair-1752012855", "user_data": "}} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:29:19.879174 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.network.neutron [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] validate_networks() for [('738fa312-d388-4da8-be3f-aad30d233548', None, None, None, None, None)] {{(pid=118263) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:29:20.347889 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Flavor limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:29:20.348308 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Image limits 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:29:20.348778 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Flavor pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:29:20.349212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Image pref 0:0:0 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:29:20.349616 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.virt.hardware [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:29:20.359061 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:20.359513 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:20.360311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:20.360744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:20.377615 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:29:20.381820 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.quota [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Getting quotas for user 8d824401d1454a2bb19d7628e38b256a and project cc4efb6abcf3412897b7f1484988aa2b. Resources: {'cores', 'instances', 'ram'} {{(pid=118263) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:29:20.393409 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Going to run 1 instances... {{(pid=118263) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:29:20.395673 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f065e937-343c-4647-9849-e13f751971c9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:29:20.516859 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-00dde3f7-06af-4a1c-8291-db229f9a9db6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.746025 Jul 14 12:29:20.517509 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 567/1150] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:29:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:29:20.527964 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-1bddd058-a898-472c-8de5-eafc3f3da9a7 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:20.528563 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-1bddd058-a898-472c-8de5-eafc3f3da9a7 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:20.582564 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-1bddd058-a898-472c-8de5-eafc3f3da9a7 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:20.593997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-1bddd058-a898-472c-8de5-eafc3f3da9a7 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1242 microversion: 2.1 time: 0.070257 Jul 14 12:29:20.594589 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 584/1151] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:20 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:21.611683 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cc0a597a-7832-4d5c-b473-50d147393d45 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:21.612310 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-cc0a597a-7832-4d5c-b473-50d147393d45 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:21.619576 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cc0a597a-7832-4d5c-b473-50d147393d45 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:21.620026 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cc0a597a-7832-4d5c-b473-50d147393d45 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:21.620888 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cc0a597a-7832-4d5c-b473-50d147393d45 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:21.621334 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cc0a597a-7832-4d5c-b473-50d147393d45 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:21.681739 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-cc0a597a-7832-4d5c-b473-50d147393d45 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:21.691199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-cc0a597a-7832-4d5c-b473-50d147393d45 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1246 microversion: 2.1 time: 0.084612 Jul 14 12:29:21.691772 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 568/1152] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:21 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:22.709057 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-5c321a97-c4e7-49cc-b9d4-87704babcd58 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:22.709450 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-5c321a97-c4e7-49cc-b9d4-87704babcd58 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:22.715949 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5c321a97-c4e7-49cc-b9d4-87704babcd58 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:22.716400 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5c321a97-c4e7-49cc-b9d4-87704babcd58 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:22.717232 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5c321a97-c4e7-49cc-b9d4-87704babcd58 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:22.717671 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-5c321a97-c4e7-49cc-b9d4-87704babcd58 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:22.785501 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-5c321a97-c4e7-49cc-b9d4-87704babcd58 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:22.793247 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-5c321a97-c4e7-49cc-b9d4-87704babcd58 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1302 microversion: 2.1 time: 0.088479 Jul 14 12:29:22.793821 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 585/1153] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:22 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:23.810353 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cb7ec963-1a7b-41dc-814b-4030215dc7e4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:23.811061 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-cb7ec963-1a7b-41dc-814b-4030215dc7e4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:23.817676 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cb7ec963-1a7b-41dc-814b-4030215dc7e4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:23.818124 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cb7ec963-1a7b-41dc-814b-4030215dc7e4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:23.818910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cb7ec963-1a7b-41dc-814b-4030215dc7e4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:23.819343 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cb7ec963-1a7b-41dc-814b-4030215dc7e4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:24.014158 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-cb7ec963-1a7b-41dc-814b-4030215dc7e4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:24.022150 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-cb7ec963-1a7b-41dc-814b-4030215dc7e4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1368 microversion: 2.1 time: 0.215237 Jul 14 12:29:24.022293 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 569/1154] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:23 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:24.456177 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-98944c38-b7d6-4849-be5a-bbef4f79e5d4 req-24c9db8a-34ce-4cb0-b2d3-be694b503949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9165911d-50d6-4f97-958b-fd82bd5a3e34", "tag": "73530a58-9545-4597-8d97-78d19966975b"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:29:24.464639 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-98944c38-b7d6-4849-be5a-bbef4f79e5d4 req-24c9db8a-34ce-4cb0-b2d3-be694b503949 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:24.465435 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-98944c38-b7d6-4849-be5a-bbef4f79e5d4 req-24c9db8a-34ce-4cb0-b2d3-be694b503949 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:24.478028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-98944c38-b7d6-4849-be5a-bbef4f79e5d4 req-24c9db8a-34ce-4cb0-b2d3-be694b503949 service nova] Creating event network-changed:73530a58-9545-4597-8d97-78d19966975b for instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 on hv-cinder-84890 Jul 14 12:29:24.483647 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-98944c38-b7d6-4849-be5a-bbef4f79e5d4 req-24c9db8a-34ce-4cb0-b2d3-be694b503949 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031185 Jul 14 12:29:24.484205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 586/1155] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:29:25.038166 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-38fb084e-8545-434f-912a-939a1ef247c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:25.038809 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-38fb084e-8545-434f-912a-939a1ef247c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:25.045546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-38fb084e-8545-434f-912a-939a1ef247c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:25.045998 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-38fb084e-8545-434f-912a-939a1ef247c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:25.046794 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-38fb084e-8545-434f-912a-939a1ef247c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:25.047241 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-38fb084e-8545-434f-912a-939a1ef247c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:25.254799 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-38fb084e-8545-434f-912a-939a1ef247c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:25.262089 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-38fb084e-8545-434f-912a-939a1ef247c8 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1368 microversion: 2.1 time: 0.227939 Jul 14 12:29:25.262653 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 570/1156] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:25 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:26.281335 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b4e6b725-dbbf-47e9-ae6b-e8e30341db67 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:26.282042 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b4e6b725-dbbf-47e9-ae6b-e8e30341db67 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:26.288333 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b4e6b725-dbbf-47e9-ae6b-e8e30341db67 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:26.288782 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b4e6b725-dbbf-47e9-ae6b-e8e30341db67 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:26.289544 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b4e6b725-dbbf-47e9-ae6b-e8e30341db67 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:26.289983 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b4e6b725-dbbf-47e9-ae6b-e8e30341db67 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:26.416711 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-b4e6b725-dbbf-47e9-ae6b-e8e30341db67 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:26.424418 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b4e6b725-dbbf-47e9-ae6b-e8e30341db67 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1368 microversion: 2.1 time: 0.148289 Jul 14 12:29:26.424984 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 587/1157] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:26 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:27.441118 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-c73426a2-4114-40b5-9ed8-905132aa2d7a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:27.441736 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-c73426a2-4114-40b5-9ed8-905132aa2d7a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:27.448196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c73426a2-4114-40b5-9ed8-905132aa2d7a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:27.448636 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c73426a2-4114-40b5-9ed8-905132aa2d7a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:27.449387 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c73426a2-4114-40b5-9ed8-905132aa2d7a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:27.449815 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-c73426a2-4114-40b5-9ed8-905132aa2d7a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:27.577715 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-c73426a2-4114-40b5-9ed8-905132aa2d7a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:27.585145 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-c73426a2-4114-40b5-9ed8-905132aa2d7a tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1368 microversion: 2.1 time: 0.147946 Jul 14 12:29:27.585718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 571/1158] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:27 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:28.604286 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-87572c59-42d4-4738-9461-725677251537 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:28.604907 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-87572c59-42d4-4738-9461-725677251537 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:28.612132 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-87572c59-42d4-4738-9461-725677251537 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:28.612589 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-87572c59-42d4-4738-9461-725677251537 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:28.613354 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-87572c59-42d4-4738-9461-725677251537 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:28.613793 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-87572c59-42d4-4738-9461-725677251537 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:28.743561 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-87572c59-42d4-4738-9461-725677251537 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:28.751241 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-87572c59-42d4-4738-9461-725677251537 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1368 microversion: 2.1 time: 0.150860 Jul 14 12:29:28.751807 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 588/1159] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:28 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:29.768591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-738a75dc-a234-4ad6-bd71-e40b10555225 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:29.769213 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-738a75dc-a234-4ad6-bd71-e40b10555225 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:29.775975 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-738a75dc-a234-4ad6-bd71-e40b10555225 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:29.776457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-738a75dc-a234-4ad6-bd71-e40b10555225 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:29.777997 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-738a75dc-a234-4ad6-bd71-e40b10555225 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:29.778343 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-738a75dc-a234-4ad6-bd71-e40b10555225 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:30.028449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-738a75dc-a234-4ad6-bd71-e40b10555225 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:30.037559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-738a75dc-a234-4ad6-bd71-e40b10555225 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1368 microversion: 2.1 time: 0.272770 Jul 14 12:29:30.038148 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 572/1160] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:29 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1368 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:31.055319 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-36e07713-07a1-49b6-a66d-929b48391fd5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:31.118655 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-36e07713-07a1-49b6-a66d-929b48391fd5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:31.118655 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=6 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:29:31.118655 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:29:31.118655 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36e07713-07a1-49b6-a66d-929b48391fd5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:31.118655 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36e07713-07a1-49b6-a66d-929b48391fd5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:31.119848 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36e07713-07a1-49b6-a66d-929b48391fd5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:31.119848 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-36e07713-07a1-49b6-a66d-929b48391fd5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:31.119848 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:29:31.195866 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-36e07713-07a1-49b6-a66d-929b48391fd5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:31.203578 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-36e07713-07a1-49b6-a66d-929b48391fd5 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1368 microversion: 2.1 time: 0.152149 Jul 14 12:29:31.204167 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 589/1161] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:31 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:31.454367 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:29:31.455260 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=6 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:29:31.514252 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-a170e3ff-2e72-4756-93ad-1baab59d806b req-6794204b-adef-495d-959b-c53bc39097ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9165911d-50d6-4f97-958b-fd82bd5a3e34", "name": "network-vif-plugged", "status": "completed", "tag": "73530a58-9545-4597-8d97-78d19966975b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:29:31.522435 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-a170e3ff-2e72-4756-93ad-1baab59d806b req-6794204b-adef-495d-959b-c53bc39097ba service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:31.522901 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-a170e3ff-2e72-4756-93ad-1baab59d806b req-6794204b-adef-495d-959b-c53bc39097ba service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:31.534114 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-a170e3ff-2e72-4756-93ad-1baab59d806b req-6794204b-adef-495d-959b-c53bc39097ba service nova] Creating event network-vif-plugged:73530a58-9545-4597-8d97-78d19966975b for instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 on hv-cinder-84890 Jul 14 12:29:31.539138 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-a170e3ff-2e72-4756-93ad-1baab59d806b req-6794204b-adef-495d-959b-c53bc39097ba service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089656 Jul 14 12:29:31.539722 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 573/1162] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:29:32.221049 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6ef73c3d-26ac-4f12-ab27-9accdeeab188 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:32.221670 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6ef73c3d-26ac-4f12-ab27-9accdeeab188 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:32.229436 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6ef73c3d-26ac-4f12-ab27-9accdeeab188 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:32.229940 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6ef73c3d-26ac-4f12-ab27-9accdeeab188 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:32.230706 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6ef73c3d-26ac-4f12-ab27-9accdeeab188 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:32.231174 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6ef73c3d-26ac-4f12-ab27-9accdeeab188 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:32.360977 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-6ef73c3d-26ac-4f12-ab27-9accdeeab188 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:32.368241 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6ef73c3d-26ac-4f12-ab27-9accdeeab188 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1368 microversion: 2.1 time: 0.151660 Jul 14 12:29:32.368806 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 590/1163] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:32 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:33.386941 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-8adfe4c3-76fb-4b8f-9743-9303f98542d1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:33.387546 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-8adfe4c3-76fb-4b8f-9743-9303f98542d1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:33.395125 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8adfe4c3-76fb-4b8f-9743-9303f98542d1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:33.395565 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8adfe4c3-76fb-4b8f-9743-9303f98542d1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:33.396314 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8adfe4c3-76fb-4b8f-9743-9303f98542d1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:33.396742 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-8adfe4c3-76fb-4b8f-9743-9303f98542d1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:33.531384 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-8adfe4c3-76fb-4b8f-9743-9303f98542d1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:33.538681 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-8adfe4c3-76fb-4b8f-9743-9303f98542d1 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1558 microversion: 2.1 time: 0.156862 Jul 14 12:29:33.542848 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 574/1164] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:33 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:33.556318 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-af839fc1-df62-42ec-ab86-8ce5a750ce7d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:33.556911 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-af839fc1-df62-42ec-ab86-8ce5a750ce7d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:33.563297 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-af839fc1-df62-42ec-ab86-8ce5a750ce7d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:33.563746 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-af839fc1-df62-42ec-ab86-8ce5a750ce7d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:33.564506 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-af839fc1-df62-42ec-ab86-8ce5a750ce7d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:33.564987 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-af839fc1-df62-42ec-ab86-8ce5a750ce7d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:33.650190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-af839fc1-df62-42ec-ab86-8ce5a750ce7d tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096410 Jul 14 12:29:33.650190 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 591/1165] 10.222.0.27 () {58 vars in 1274 bytes} [Thu Jul 14 12:29:33 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:29:34.865554 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-1a5d78e6-d4f9-4ecf-a9fe-0695ea104cd8 req-4d270c32-988d-4650-b6e7-45c7b6bb7e9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9165911d-50d6-4f97-958b-fd82bd5a3e34", "tag": "73530a58-9545-4597-8d97-78d19966975b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:29:34.874748 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-1a5d78e6-d4f9-4ecf-a9fe-0695ea104cd8 req-4d270c32-988d-4650-b6e7-45c7b6bb7e9f service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:34.875211 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-1a5d78e6-d4f9-4ecf-a9fe-0695ea104cd8 req-4d270c32-988d-4650-b6e7-45c7b6bb7e9f service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:34.886238 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-1a5d78e6-d4f9-4ecf-a9fe-0695ea104cd8 req-4d270c32-988d-4650-b6e7-45c7b6bb7e9f service nova] Creating event network-changed:73530a58-9545-4597-8d97-78d19966975b for instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 on hv-cinder-84890 Jul 14 12:29:34.891948 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-1a5d78e6-d4f9-4ecf-a9fe-0695ea104cd8 req-4d270c32-988d-4650-b6e7-45c7b6bb7e9f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030008 Jul 14 12:29:34.892672 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 575/1166] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:29:49.130403 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=5 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:29:49.131266 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=15 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:29:49.135199 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-87321041", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-153859730", "security_groups": [{"name": "tempest-secgroup-smoke-1834465563"}], "block_device_mapping_v2": [{"uuid": "11104439-4c25-4888-aa79-7b92eabb8786", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e86e92bf-9b7d-465e-8fb7-65ffe1a278e1"}]}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:29:49.244806 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.network.neutron [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] validate_networks() for [('e86e92bf-9b7d-465e-8fb7-65ffe1a278e1', None, None, None, None, None)] {{(pid=118262) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 12:29:49.629367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Flavor limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 12:29:49.629807 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Image limits 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 12:29:49.630265 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Flavor pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 12:29:49.630668 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Image pref 0:0:0 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 12:29:49.631105 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.virt.hardware [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 12:29:49.641433 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:49.641877 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:49.642668 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:49.643131 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:49.660448 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Getting quotas for project c0d098ca721b409385a08b91d861b295. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 12:29:49.664398 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.quota [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Getting quotas for user d0adaa092d944202b3279d10e0f94a91 and project c0d098ca721b409385a08b91d861b295. Resources: {'cores', 'instances', 'ram'} {{(pid=118262) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 12:29:49.720345 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Going to run 1 instances... {{(pid=118262) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 12:29:49.722500 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='11104439-4c25-4888-aa79-7b92eabb8786',volume_size=None,volume_type=None)] {{(pid=118262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 12:29:50.159763 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4a600479-e1d1-4b48-b95a-1f70920409d0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.030493 Jul 14 12:29:50.160468 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 592/1167] 10.222.0.27 () {60 vars in 1146 bytes} [Thu Jul 14 12:29:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 12:29:50.168717 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:29:50.169999 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=84 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:29:50.173995 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2554ed4d-fc5d-48b2-a50c-bd8c34631134 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:50.174688 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2554ed4d-fc5d-48b2-a50c-bd8c34631134 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:50.234637 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-2554ed4d-fc5d-48b2-a50c-bd8c34631134 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:50.242482 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2554ed4d-fc5d-48b2-a50c-bd8c34631134 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1092 microversion: 2.1 time: 0.075707 Jul 14 12:29:50.247917 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 576/1168] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:50 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1092 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:51.259768 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4a5556b0-58de-4fb2-80c1-42fc7caf2bce tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:51.260340 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4a5556b0-58de-4fb2-80c1-42fc7caf2bce tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:51.267594 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a5556b0-58de-4fb2-80c1-42fc7caf2bce tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:51.268046 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a5556b0-58de-4fb2-80c1-42fc7caf2bce tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:51.268826 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a5556b0-58de-4fb2-80c1-42fc7caf2bce tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:51.269268 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4a5556b0-58de-4fb2-80c1-42fc7caf2bce tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:51.332840 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-4a5556b0-58de-4fb2-80c1-42fc7caf2bce tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:51.340384 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4a5556b0-58de-4fb2-80c1-42fc7caf2bce tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1134 microversion: 2.1 time: 0.084826 Jul 14 12:29:51.341210 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 593/1169] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:51 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1134 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:52.357935 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-88a6909d-5412-4cbf-b1f2-3e2be6139a3f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:52.358901 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-88a6909d-5412-4cbf-b1f2-3e2be6139a3f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:52.366879 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-88a6909d-5412-4cbf-b1f2-3e2be6139a3f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:52.367552 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-88a6909d-5412-4cbf-b1f2-3e2be6139a3f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:52.368679 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-88a6909d-5412-4cbf-b1f2-3e2be6139a3f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:52.369125 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-88a6909d-5412-4cbf-b1f2-3e2be6139a3f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:52.463518 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-88a6909d-5412-4cbf-b1f2-3e2be6139a3f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:52.471974 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-88a6909d-5412-4cbf-b1f2-3e2be6139a3f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1208 microversion: 2.1 time: 0.118311 Jul 14 12:29:52.472539 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 577/1170] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:52 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1208 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:53.488856 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-fc805995-6cb9-4148-8fb5-151da0fa570d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:53.489472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-fc805995-6cb9-4148-8fb5-151da0fa570d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:53.499095 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc805995-6cb9-4148-8fb5-151da0fa570d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:53.509889 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc805995-6cb9-4148-8fb5-151da0fa570d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:53.509889 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc805995-6cb9-4148-8fb5-151da0fa570d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:53.509889 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-fc805995-6cb9-4148-8fb5-151da0fa570d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:53.636138 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-fc805995-6cb9-4148-8fb5-151da0fa570d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:53.645388 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-fc805995-6cb9-4148-8fb5-151da0fa570d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1276 microversion: 2.1 time: 0.160174 Jul 14 12:29:53.645907 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 594/1171] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:53 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:53.979477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-4d67c2c4-20a2-486a-a995-a9cbcf718f5c req-fef880a9-b569-4ae0-8659-e37cdc5f4f07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f655b530-8145-4a12-bc24-b9836528039c", "tag": "ee3f4594-51d6-48db-a1d9-2d05b7a76d60"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:29:53.995862 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-4d67c2c4-20a2-486a-a995-a9cbcf718f5c req-fef880a9-b569-4ae0-8659-e37cdc5f4f07 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:53.996473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-4d67c2c4-20a2-486a-a995-a9cbcf718f5c req-fef880a9-b569-4ae0-8659-e37cdc5f4f07 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:54.014118 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-4d67c2c4-20a2-486a-a995-a9cbcf718f5c req-fef880a9-b569-4ae0-8659-e37cdc5f4f07 service nova] Creating event network-changed:ee3f4594-51d6-48db-a1d9-2d05b7a76d60 for instance f655b530-8145-4a12-bc24-b9836528039c on hv-cinder-84890 Jul 14 12:29:54.019266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-4d67c2c4-20a2-486a-a995-a9cbcf718f5c req-fef880a9-b569-4ae0-8659-e37cdc5f4f07 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044385 Jul 14 12:29:54.021109 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 578/1172] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:29:54.662730 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-c9a1a87c-408b-442e-8ba3-f3b8e5bdd119 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:54.663383 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-c9a1a87c-408b-442e-8ba3-f3b8e5bdd119 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:54.670448 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c9a1a87c-408b-442e-8ba3-f3b8e5bdd119 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:54.674444 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c9a1a87c-408b-442e-8ba3-f3b8e5bdd119 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:54.674444 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c9a1a87c-408b-442e-8ba3-f3b8e5bdd119 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:54.674444 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-c9a1a87c-408b-442e-8ba3-f3b8e5bdd119 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:54.807092 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-c9a1a87c-408b-442e-8ba3-f3b8e5bdd119 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:54.815324 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-c9a1a87c-408b-442e-8ba3-f3b8e5bdd119 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.156440 Jul 14 12:29:54.815935 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 595/1173] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:54 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:55.833167 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-bf854515-f5c8-40ee-b971-6a247ba4983c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:55.833894 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-bf854515-f5c8-40ee-b971-6a247ba4983c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:55.840161 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf854515-f5c8-40ee-b971-6a247ba4983c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:55.841228 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf854515-f5c8-40ee-b971-6a247ba4983c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:55.842082 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf854515-f5c8-40ee-b971-6a247ba4983c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:55.842515 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-bf854515-f5c8-40ee-b971-6a247ba4983c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:55.976655 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-bf854515-f5c8-40ee-b971-6a247ba4983c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:55.984820 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-bf854515-f5c8-40ee-b971-6a247ba4983c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.156207 Jul 14 12:29:55.985324 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 579/1174] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:55 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:57.001975 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e6a415e3-b548-4c9b-a4d6-0660a5b3969f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:57.002521 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e6a415e3-b548-4c9b-a4d6-0660a5b3969f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:57.008937 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e6a415e3-b548-4c9b-a4d6-0660a5b3969f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:57.009387 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e6a415e3-b548-4c9b-a4d6-0660a5b3969f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:57.010145 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e6a415e3-b548-4c9b-a4d6-0660a5b3969f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:57.010580 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e6a415e3-b548-4c9b-a4d6-0660a5b3969f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:57.137896 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-e6a415e3-b548-4c9b-a4d6-0660a5b3969f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:57.145390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e6a415e3-b548-4c9b-a4d6-0660a5b3969f tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.147361 Jul 14 12:29:57.145958 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 596/1175] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:56 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:58.161976 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-80b96b4f-c6c0-4e84-94f5-d1e74d22ac8e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:58.162520 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-80b96b4f-c6c0-4e84-94f5-d1e74d22ac8e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:58.170427 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-80b96b4f-c6c0-4e84-94f5-d1e74d22ac8e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:58.171111 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-80b96b4f-c6c0-4e84-94f5-d1e74d22ac8e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:58.171997 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-80b96b4f-c6c0-4e84-94f5-d1e74d22ac8e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:58.172428 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-80b96b4f-c6c0-4e84-94f5-d1e74d22ac8e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:58.300374 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-80b96b4f-c6c0-4e84-94f5-d1e74d22ac8e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:58.307830 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-80b96b4f-c6c0-4e84-94f5-d1e74d22ac8e tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.149850 Jul 14 12:29:58.308392 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 580/1176] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:58 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:29:59.324916 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-17104575-87c4-4188-b7b7-e43568246bf0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:29:59.325520 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-17104575-87c4-4188-b7b7-e43568246bf0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:29:59.332176 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-17104575-87c4-4188-b7b7-e43568246bf0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:59.332620 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-17104575-87c4-4188-b7b7-e43568246bf0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:59.333381 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-17104575-87c4-4188-b7b7-e43568246bf0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:29:59.333811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-17104575-87c4-4188-b7b7-e43568246bf0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:29:59.466028 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-17104575-87c4-4188-b7b7-e43568246bf0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:29:59.473636 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-17104575-87c4-4188-b7b7-e43568246bf0 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.152663 Jul 14 12:29:59.474510 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 597/1177] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:29:59 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:00.491046 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ff9ff366-7265-4f44-88a8-d1e19d6f94b1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:00.491567 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ff9ff366-7265-4f44-88a8-d1e19d6f94b1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:00.493991 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell0:SELECT=2 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:30:00.500282 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ff9ff366-7265-4f44-88a8-d1e19d6f94b1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:00.500723 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ff9ff366-7265-4f44-88a8-d1e19d6f94b1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:00.501474 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ff9ff366-7265-4f44-88a8-d1e19d6f94b1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:00.501904 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ff9ff366-7265-4f44-88a8-d1e19d6f94b1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:00.635270 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-ff9ff366-7265-4f44-88a8-d1e19d6f94b1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:00.642757 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ff9ff366-7265-4f44-88a8-d1e19d6f94b1 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.155772 Jul 14 12:30:00.643406 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 581/1178] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:00 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:01.659965 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8522ee2c-95bc-4972-a04c-52396e4556dc tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:01.660586 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8522ee2c-95bc-4972-a04c-52396e4556dc tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:01.662373 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=2 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:30:01.663088 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell0:SELECT=6 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:30:01.669218 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8522ee2c-95bc-4972-a04c-52396e4556dc tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:01.669663 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8522ee2c-95bc-4972-a04c-52396e4556dc tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:01.670416 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8522ee2c-95bc-4972-a04c-52396e4556dc tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:01.670882 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8522ee2c-95bc-4972-a04c-52396e4556dc tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:01.802632 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-8522ee2c-95bc-4972-a04c-52396e4556dc tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:01.810486 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8522ee2c-95bc-4972-a04c-52396e4556dc tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.154425 Jul 14 12:30:01.811089 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 598/1179] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:01 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:02.827632 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-032c7184-42b8-48da-a054-2cd6d6c75c53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:02.828242 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-032c7184-42b8-48da-a054-2cd6d6c75c53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:02.834798 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-032c7184-42b8-48da-a054-2cd6d6c75c53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:02.835245 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-032c7184-42b8-48da-a054-2cd6d6c75c53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:02.836014 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-032c7184-42b8-48da-a054-2cd6d6c75c53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:02.836449 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-032c7184-42b8-48da-a054-2cd6d6c75c53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:02.973457 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-032c7184-42b8-48da-a054-2cd6d6c75c53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:02.981641 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-032c7184-42b8-48da-a054-2cd6d6c75c53 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.157801 Jul 14 12:30:02.982141 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 582/1180] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:02 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:03.998000 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-06105817-04fd-4f26-b3f4-31db0c615fa3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:03.998724 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-06105817-04fd-4f26-b3f4-31db0c615fa3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:04.005139 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-06105817-04fd-4f26-b3f4-31db0c615fa3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:04.005586 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-06105817-04fd-4f26-b3f4-31db0c615fa3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:04.006348 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-06105817-04fd-4f26-b3f4-31db0c615fa3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:04.006801 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-06105817-04fd-4f26-b3f4-31db0c615fa3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:04.139895 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-06105817-04fd-4f26-b3f4-31db0c615fa3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:04.147322 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-06105817-04fd-4f26-b3f4-31db0c615fa3 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.153712 Jul 14 12:30:04.147887 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 599/1181] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:03 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:05.164910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-7c3518a3-60d4-44d9-aa45-b488038b97ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:05.165441 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-7c3518a3-60d4-44d9-aa45-b488038b97ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:05.172220 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7c3518a3-60d4-44d9-aa45-b488038b97ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:05.172678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7c3518a3-60d4-44d9-aa45-b488038b97ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:05.173443 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7c3518a3-60d4-44d9-aa45-b488038b97ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:05.173882 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-7c3518a3-60d4-44d9-aa45-b488038b97ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:05.303210 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-7c3518a3-60d4-44d9-aa45-b488038b97ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:05.310510 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-7c3518a3-60d4-44d9-aa45-b488038b97ea tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.149561 Jul 14 12:30:05.311104 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 583/1182] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:05 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:05.649382 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-b4bff8db-65cb-426f-91bc-774397a10e2d req-cd8ae956-60e3-48b4-8de6-026e785baf59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f655b530-8145-4a12-bc24-b9836528039c", "name": "network-vif-plugged", "status": "completed", "tag": "ee3f4594-51d6-48db-a1d9-2d05b7a76d60"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:30:05.658529 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-b4bff8db-65cb-426f-91bc-774397a10e2d req-cd8ae956-60e3-48b4-8de6-026e785baf59 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:05.658999 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-b4bff8db-65cb-426f-91bc-774397a10e2d req-cd8ae956-60e3-48b4-8de6-026e785baf59 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:05.670857 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-b4bff8db-65cb-426f-91bc-774397a10e2d req-cd8ae956-60e3-48b4-8de6-026e785baf59 service nova] Creating event network-vif-plugged:ee3f4594-51d6-48db-a1d9-2d05b7a76d60 for instance f655b530-8145-4a12-bc24-b9836528039c on hv-cinder-84890 Jul 14 12:30:05.675903 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-b4bff8db-65cb-426f-91bc-774397a10e2d req-cd8ae956-60e3-48b4-8de6-026e785baf59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030251 Jul 14 12:30:05.676488 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 600/1183] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:30:06.327841 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-749c9e20-838c-47dc-adf3-c028d2288ab7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:06.328459 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-749c9e20-838c-47dc-adf3-c028d2288ab7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:06.334958 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-749c9e20-838c-47dc-adf3-c028d2288ab7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:06.335460 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-749c9e20-838c-47dc-adf3-c028d2288ab7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:06.336167 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-749c9e20-838c-47dc-adf3-c028d2288ab7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:06.336598 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-749c9e20-838c-47dc-adf3-c028d2288ab7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:06.464414 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-749c9e20-838c-47dc-adf3-c028d2288ab7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:06.471927 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-749c9e20-838c-47dc-adf3-c028d2288ab7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1264 microversion: 2.1 time: 0.148605 Jul 14 12:30:06.472499 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 584/1184] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:06 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:07.488669 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-faacf130-59b3-4863-b65a-f116df7ba196 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:07.489412 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-faacf130-59b3-4863-b65a-f116df7ba196 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:07.495692 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-faacf130-59b3-4863-b65a-f116df7ba196 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:07.496175 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-faacf130-59b3-4863-b65a-f116df7ba196 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:07.496979 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-faacf130-59b3-4863-b65a-f116df7ba196 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:07.497410 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-faacf130-59b3-4863-b65a-f116df7ba196 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:07.629885 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-faacf130-59b3-4863-b65a-f116df7ba196 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:07.638064 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-faacf130-59b3-4863-b65a-f116df7ba196 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1451 microversion: 2.1 time: 0.154045 Jul 14 12:30:07.642599 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 601/1185] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:07 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:07.654673 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-174c84fc-bd72-4701-9631-5fb25e80e226 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:07.655351 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-174c84fc-bd72-4701-9631-5fb25e80e226 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:07.661921 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-174c84fc-bd72-4701-9631-5fb25e80e226 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:07.662367 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-174c84fc-bd72-4701-9631-5fb25e80e226 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:07.663157 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-174c84fc-bd72-4701-9631-5fb25e80e226 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:07.663592 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-174c84fc-bd72-4701-9631-5fb25e80e226 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:07.797094 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-174c84fc-bd72-4701-9631-5fb25e80e226 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:07.804711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-174c84fc-bd72-4701-9631-5fb25e80e226 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1451 microversion: 2.1 time: 0.154719 Jul 14 12:30:07.805278 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 585/1186] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:07 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:09.890196 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-effae3f9-98d2-4793-8390-e86e67968e5e req-09b0a470-d2eb-4b86-9482-bae43b895cdc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f655b530-8145-4a12-bc24-b9836528039c", "tag": "ee3f4594-51d6-48db-a1d9-2d05b7a76d60"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:30:09.899661 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-effae3f9-98d2-4793-8390-e86e67968e5e req-09b0a470-d2eb-4b86-9482-bae43b895cdc service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:09.900110 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-effae3f9-98d2-4793-8390-e86e67968e5e req-09b0a470-d2eb-4b86-9482-bae43b895cdc service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:09.912521 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-effae3f9-98d2-4793-8390-e86e67968e5e req-09b0a470-d2eb-4b86-9482-bae43b895cdc service nova] Creating event network-changed:ee3f4594-51d6-48db-a1d9-2d05b7a76d60 for instance f655b530-8145-4a12-bc24-b9836528039c on hv-cinder-84890 Jul 14 12:30:09.918315 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-effae3f9-98d2-4793-8390-e86e67968e5e req-09b0a470-d2eb-4b86-9482-bae43b895cdc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031070 Jul 14 12:30:09.919000 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 602/1187] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:30:18.461594 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-eee4bf22-5919-4ca4-bcbf-77c56242d0dc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:18.462202 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-eee4bf22-5919-4ca4-bcbf-77c56242d0dc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:18.464282 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=22 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:30:18.465025 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=50 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:30:18.469816 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-eee4bf22-5919-4ca4-bcbf-77c56242d0dc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:18.470266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-eee4bf22-5919-4ca4-bcbf-77c56242d0dc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:18.471068 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-eee4bf22-5919-4ca4-bcbf-77c56242d0dc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:18.471503 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-eee4bf22-5919-4ca4-bcbf-77c56242d0dc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:18.494440 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-eee4bf22-5919-4ca4-bcbf-77c56242d0dc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/ips" status: 200 len: 150 microversion: 2.1 time: 0.036895 Jul 14 12:30:18.496418 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 586/1188] 10.222.0.27 () {58 vars in 1247 bytes} [Thu Jul 14 12:30:18 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:30:20.117452 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:30:20.118200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=54 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:30:20.123054 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9f8f9296-30b9-479a-b3cd-6e2df5a410c4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2af0e51-3a20-4e47-b2e7-f261b385bba7"}} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:30:20.124203 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-9f8f9296-30b9-479a-b3cd-6e2df5a410c4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:20.130391 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f8f9296-30b9-479a-b3cd-6e2df5a410c4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:20.132573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f8f9296-30b9-479a-b3cd-6e2df5a410c4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:20.132573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f8f9296-30b9-479a-b3cd-6e2df5a410c4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:20.132573 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9f8f9296-30b9-479a-b3cd-6e2df5a410c4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:20.852161 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9f8f9296-30b9-479a-b3cd-6e2df5a410c4 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "POST /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.735949 Jul 14 12:30:20.852798 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 603/1189] 10.222.0.27 () {60 vars in 1322 bytes} [Thu Jul 14 12:30:20 2022] POST /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-volume_attachments => generated 194 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:30:29.482631 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-b72ed182-50ec-4759-aebc-47ff8ed6818b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:29.483239 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-b72ed182-50ec-4759-aebc-47ff8ed6818b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:29.490478 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b72ed182-50ec-4759-aebc-47ff8ed6818b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:29.490960 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b72ed182-50ec-4759-aebc-47ff8ed6818b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:29.491721 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b72ed182-50ec-4759-aebc-47ff8ed6818b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:29.492153 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-b72ed182-50ec-4759-aebc-47ff8ed6818b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:29.573137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.objects.instance [None req-b72ed182-50ec-4759-aebc-47ff8ed6818b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lazy-loading 'services' on Instance uuid 9165911d-50d6-4f97-958b-fd82bd5a3e34 {{(pid=118263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:30:29.804781 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-b72ed182-50ec-4759-aebc-47ff8ed6818b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-volume_attachments/f2af0e51-3a20-4e47-b2e7-f261b385bba7" status: 202 len: 0 microversion: 2.1 time: 0.326490 Jul 14 12:30:29.805320 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 587/1190] 10.222.0.27 () {58 vars in 1415 bytes} [Thu Jul 14 12:30:29 2022] DELETE /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-volume_attachments/f2af0e51-3a20-4e47-b2e7-f261b385bba7 => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:30:29.815809 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-b746bf7c-f8ed-4cae-a3c4-0c2909918a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:29.816811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-b746bf7c-f8ed-4cae-a3c4-0c2909918a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:29.823267 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b746bf7c-f8ed-4cae-a3c4-0c2909918a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:29.823722 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b746bf7c-f8ed-4cae-a3c4-0c2909918a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:29.824508 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b746bf7c-f8ed-4cae-a3c4-0c2909918a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:29.824945 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-b746bf7c-f8ed-4cae-a3c4-0c2909918a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:29.854602 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-b746bf7c-f8ed-4cae-a3c4-0c2909918a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043928 Jul 14 12:30:29.855193 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 604/1191] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:30:29 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:30:30.871476 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-44bfe885-583e-40ba-8828-dc4a0190af26 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:30.873701 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-44bfe885-583e-40ba-8828-dc4a0190af26 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:30.881697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-44bfe885-583e-40ba-8828-dc4a0190af26 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:30.882268 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-44bfe885-583e-40ba-8828-dc4a0190af26 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:30.883178 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-44bfe885-583e-40ba-8828-dc4a0190af26 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:30.883706 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-44bfe885-583e-40ba-8828-dc4a0190af26 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:30.916068 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-44bfe885-583e-40ba-8828-dc4a0190af26 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052146 Jul 14 12:30:30.916591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 588/1192] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:30:30 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:30:31.928285 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-8dcf9aab-976a-4e8b-b524-733dcd46fea2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:31.929230 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-8dcf9aab-976a-4e8b-b524-733dcd46fea2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:31.935836 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8dcf9aab-976a-4e8b-b524-733dcd46fea2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:31.936286 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8dcf9aab-976a-4e8b-b524-733dcd46fea2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:31.937040 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8dcf9aab-976a-4e8b-b524-733dcd46fea2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:31.937472 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-8dcf9aab-976a-4e8b-b524-733dcd46fea2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:31.967650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-8dcf9aab-976a-4e8b-b524-733dcd46fea2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043338 Jul 14 12:30:31.968207 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 605/1193] 10.222.0.27 () {58 vars in 1301 bytes} [Thu Jul 14 12:30:31 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 12:30:32.025116 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-adb43777-b305-45f2-a400-3eb53bcb8414 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:32.025623 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-adb43777-b305-45f2-a400-3eb53bcb8414 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:32.032842 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-adb43777-b305-45f2-a400-3eb53bcb8414 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:32.033296 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-adb43777-b305-45f2-a400-3eb53bcb8414 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:32.034058 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-adb43777-b305-45f2-a400-3eb53bcb8414 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:32.034503 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-adb43777-b305-45f2-a400-3eb53bcb8414 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:32.059103 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-adb43777-b305-45f2-a400-3eb53bcb8414 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Going to try to terminate instance {{(pid=118263) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:30:32.354386 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-adb43777-b305-45f2-a400-3eb53bcb8414 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 204 len: 0 microversion: 2.1 time: 0.332668 Jul 14 12:30:32.354932 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 589/1194] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:30:32 2022] DELETE /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:30:32.363382 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-d4a73a8e-df37-4c01-9e07-02306e2378e9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:32.368051 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-d4a73a8e-df37-4c01-9e07-02306e2378e9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:32.370948 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d4a73a8e-df37-4c01-9e07-02306e2378e9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:32.371407 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d4a73a8e-df37-4c01-9e07-02306e2378e9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:32.372691 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d4a73a8e-df37-4c01-9e07-02306e2378e9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:32.373129 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-d4a73a8e-df37-4c01-9e07-02306e2378e9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:32.501260 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-d4a73a8e-df37-4c01-9e07-02306e2378e9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:32.508644 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-d4a73a8e-df37-4c01-9e07-02306e2378e9 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1683 microversion: 2.1 time: 0.149168 Jul 14 12:30:32.509215 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 606/1195] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:32 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:33.525897 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cdb97fe6-fe40-43cb-bbbd-89ed411e2a65 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:33.526591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-cdb97fe6-fe40-43cb-bbbd-89ed411e2a65 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:33.533945 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cdb97fe6-fe40-43cb-bbbd-89ed411e2a65 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:33.534385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cdb97fe6-fe40-43cb-bbbd-89ed411e2a65 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:33.535167 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cdb97fe6-fe40-43cb-bbbd-89ed411e2a65 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:33.535596 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cdb97fe6-fe40-43cb-bbbd-89ed411e2a65 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:33.669195 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-cdb97fe6-fe40-43cb-bbbd-89ed411e2a65 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:33.676561 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-cdb97fe6-fe40-43cb-bbbd-89ed411e2a65 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1683 microversion: 2.1 time: 0.154865 Jul 14 12:30:33.677117 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 590/1196] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:33 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:34.693552 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-9e2b643c-1e93-44db-9d4b-a2ae6983ff78 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:34.694310 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-9e2b643c-1e93-44db-9d4b-a2ae6983ff78 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:34.701031 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9e2b643c-1e93-44db-9d4b-a2ae6983ff78 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:34.701485 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9e2b643c-1e93-44db-9d4b-a2ae6983ff78 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:34.702272 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9e2b643c-1e93-44db-9d4b-a2ae6983ff78 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:34.702705 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-9e2b643c-1e93-44db-9d4b-a2ae6983ff78 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:34.837145 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-9e2b643c-1e93-44db-9d4b-a2ae6983ff78 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:34.845524 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-9e2b643c-1e93-44db-9d4b-a2ae6983ff78 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1683 microversion: 2.1 time: 0.155851 Jul 14 12:30:34.846281 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 607/1197] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:34 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:35.308742 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-14e48b7a-06cd-422a-a1c4-abed37e592fc req-dce7395a-bf2f-4a45-88d1-24d51ea34c2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9165911d-50d6-4f97-958b-fd82bd5a3e34", "name": "network-vif-deleted", "tag": "73530a58-9545-4597-8d97-78d19966975b"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:30:35.317098 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-14e48b7a-06cd-422a-a1c4-abed37e592fc req-dce7395a-bf2f-4a45-88d1-24d51ea34c2f service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:35.320085 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-14e48b7a-06cd-422a-a1c4-abed37e592fc req-dce7395a-bf2f-4a45-88d1-24d51ea34c2f service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:35.329478 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-14e48b7a-06cd-422a-a1c4-abed37e592fc req-dce7395a-bf2f-4a45-88d1-24d51ea34c2f service nova] Creating event network-vif-deleted:73530a58-9545-4597-8d97-78d19966975b for instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 on hv-cinder-84890 Jul 14 12:30:35.334803 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-14e48b7a-06cd-422a-a1c4-abed37e592fc req-dce7395a-bf2f-4a45-88d1-24d51ea34c2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030225 Jul 14 12:30:35.335547 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 591/1198] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:30:35.862420 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:35.863000 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:35.870076 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:35.870530 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:35.871383 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:35.872411 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:35.903317 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:35.903763 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:35.904217 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lazy-loading 'fault' on Instance uuid 9165911d-50d6-4f97-958b-fd82bd5a3e34 {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:30:35.946658 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d824401d1454a2bb19d7628e38b256a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc4efb6abcf3412897b7f1484988aa2b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:30:35.955319 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-52783f6f-36d9-4517-8c53-2946b30cbe91 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 200 len: 1332 microversion: 2.1 time: 0.096730 Jul 14 12:30:35.955902 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 608/1199] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:35 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:30:36.972990 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ceb60c4b-9a0d-4171-8cc9-58101afd8a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:36.974389 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-ceb60c4b-9a0d-4171-8cc9-58101afd8a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:36.980422 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ceb60c4b-9a0d-4171-8cc9-58101afd8a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:36.980812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ceb60c4b-9a0d-4171-8cc9-58101afd8a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:36.981571 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ceb60c4b-9a0d-4171-8cc9-58101afd8a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:36.982000 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-ceb60c4b-9a0d-4171-8cc9-58101afd8a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:36.995052 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-ceb60c4b-9a0d-4171-8cc9-58101afd8a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ceb60c4b-9a0d-4171-8cc9-58101afd8a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 HTTP/1.1 Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:30:36.997172 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:36.998916 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '9165911d-50d6-4f97-958b-fd82bd5a3e34'} Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:30:36.999853 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:37.001432 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:37.002813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-ceb60c4b-9a0d-4171-8cc9-58101afd8a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:30:37.002813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-ceb60c4b-9a0d-4171-8cc9-58101afd8a5b tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 404 len: 111 microversion: 2.1 time: 0.029913 Jul 14 12:30:37.002813 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 592/1200] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:36 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:30:37.007336 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-574feddc-bcd5-44ea-adb3-8de9d595932e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '.version_select at 0x7f0e26fafee0>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:37.085844 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-574feddc-bcd5-44ea-adb3-8de9d595932e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752012855" status: 202 len: 0 microversion: 2.1 time: 0.082289 Jul 14 12:30:37.086412 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 609/1201] 10.222.0.27 () {58 vars in 1220 bytes} [Thu Jul 14 12:30:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752012855 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:30:39.070784 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2e88504a-a45c-4e9d-8c52-417e676a88d6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:39.071286 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-2e88504a-a45c-4e9d-8c52-417e676a88d6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:39.078555 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e88504a-a45c-4e9d-8c52-417e676a88d6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:39.079038 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e88504a-a45c-4e9d-8c52-417e676a88d6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:39.079805 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e88504a-a45c-4e9d-8c52-417e676a88d6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:39.080238 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-2e88504a-a45c-4e9d-8c52-417e676a88d6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:39.094058 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-2e88504a-a45c-4e9d-8c52-417e676a88d6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2e88504a-a45c-4e9d-8c52-417e676a88d6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: DELETE /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 HTTP/1.1 Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:30:39.095613 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:39.098031 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '9165911d-50d6-4f97-958b-fd82bd5a3e34'} Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:30:39.099488 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:39.102056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:39.104812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-2e88504a-a45c-4e9d-8c52-417e676a88d6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:30:39.104812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-2e88504a-a45c-4e9d-8c52-417e676a88d6 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 404 len: 111 microversion: 2.1 time: 0.030024 Jul 14 12:30:39.104812 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 593/1202] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:30:39 2022] DELETE /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:30:39.107981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e281a4a3-41a5-4dc8-8e0c-d248a66bb3b2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:39.108599 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-e281a4a3-41a5-4dc8-8e0c-d248a66bb3b2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 9165911d-50d6-4f97-958b-fd82bd5a3e34] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:39.115162 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e281a4a3-41a5-4dc8-8e0c-d248a66bb3b2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:39.115623 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e281a4a3-41a5-4dc8-8e0c-d248a66bb3b2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:39.116389 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e281a4a3-41a5-4dc8-8e0c-d248a66bb3b2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:39.116831 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-e281a4a3-41a5-4dc8-8e0c-d248a66bb3b2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:39.130512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-e281a4a3-41a5-4dc8-8e0c-d248a66bb3b2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e281a4a3-41a5-4dc8-8e0c-d248a66bb3b2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 HTTP/1.1 Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:30:39.132205 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:39.133906 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '9165911d-50d6-4f97-958b-fd82bd5a3e34'} Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:30:39.138295 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. Jul 14 12:30:39.139650 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:39.141237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-e281a4a3-41a5-4dc8-8e0c-d248a66bb3b2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance 9165911d-50d6-4f97-958b-fd82bd5a3e34 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:30:39.141237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-e281a4a3-41a5-4dc8-8e0c-d248a66bb3b2 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34" status: 404 len: 111 microversion: 2.1 time: 0.031703 Jul 14 12:30:39.141237 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 610/1203] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:39 2022] GET /compute/v2.1/servers/9165911d-50d6-4f97-958b-fd82bd5a3e34 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:30:40.429952 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f92f6303-e59e-4cf5-a353-79e8441252fc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:40.436266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-f92f6303-e59e-4cf5-a353-79e8441252fc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:40.437477 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f92f6303-e59e-4cf5-a353-79e8441252fc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:40.437924 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f92f6303-e59e-4cf5-a353-79e8441252fc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:40.438684 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f92f6303-e59e-4cf5-a353-79e8441252fc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:40.439146 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-f92f6303-e59e-4cf5-a353-79e8441252fc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:40.452928 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-f92f6303-e59e-4cf5-a353-79e8441252fc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f92f6303-e59e-4cf5-a353-79e8441252fc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: DELETE /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd HTTP/1.1 Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:30:40.454536 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:30:40.456250 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '6250940e-0393-4bf0-8653-061672eaf7fd'} Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:30:40.457137 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:30:40.458639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.460212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-f92f6303-e59e-4cf5-a353-79e8441252fc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:30:40.460212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-f92f6303-e59e-4cf5-a353-79e8441252fc tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 404 len: 111 microversion: 2.1 time: 0.029927 Jul 14 12:30:40.460212 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 594/1204] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:30:40 2022] DELETE /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:30:40.466220 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4fb2ab07-edd8-4f85-9817-816ce57fb4f0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:40.466874 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-4fb2ab07-edd8-4f85-9817-816ce57fb4f0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 6250940e-0393-4bf0-8653-061672eaf7fd] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:40.473301 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4fb2ab07-edd8-4f85-9817-816ce57fb4f0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:40.473742 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4fb2ab07-edd8-4f85-9817-816ce57fb4f0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:40.474584 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4fb2ab07-edd8-4f85-9817-816ce57fb4f0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:40.475096 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-4fb2ab07-edd8-4f85-9817-816ce57fb4f0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:40.488393 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-4fb2ab07-edd8-4f85-9817-816ce57fb4f0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4fb2ab07-edd8-4f85-9817-816ce57fb4f0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd HTTP/1.1 Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:30:40.489871 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:30:40.491512 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '6250940e-0393-4bf0-8653-061672eaf7fd'} Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:30:40.492346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. Jul 14 12:30:40.493577 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.494704 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4fb2ab07-edd8-4f85-9817-816ce57fb4f0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance 6250940e-0393-4bf0-8653-061672eaf7fd could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:30:40.494704 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4fb2ab07-edd8-4f85-9817-816ce57fb4f0 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd" status: 404 len: 111 microversion: 2.1 time: 0.029574 Jul 14 12:30:40.494704 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 611/1205] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:40 2022] GET /compute/v2.1/servers/6250940e-0393-4bf0-8653-061672eaf7fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:30:40.499785 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9de14d32-74d6-42b4-963b-770e415e505c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:40.500283 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-9de14d32-74d6-42b4-963b-770e415e505c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:40.506373 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9de14d32-74d6-42b4-963b-770e415e505c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:40.506847 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9de14d32-74d6-42b4-963b-770e415e505c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:40.507639 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9de14d32-74d6-42b4-963b-770e415e505c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:40.508080 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-9de14d32-74d6-42b4-963b-770e415e505c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:40.522196 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-9de14d32-74d6-42b4-963b-770e415e505c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9de14d32-74d6-42b4-963b-770e415e505c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: DELETE /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 HTTP/1.1 Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:30:40.523754 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:30:40.525394 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '68b91abb-69ba-44ce-af93-7223f9377f04'} Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:30:40.526311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:30:40.528559 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.530385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-9de14d32-74d6-42b4-963b-770e415e505c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:30:40.530385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-9de14d32-74d6-42b4-963b-770e415e505c tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 404 len: 111 microversion: 2.1 time: 0.029318 Jul 14 12:30:40.530385 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 595/1206] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:30:40 2022] DELETE /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 12:30:40.534372 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2bdbfefb-40ea-4453-8b43-30bf92832c0e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:40.535014 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-2bdbfefb-40ea-4453-8b43-30bf92832c0e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: 68b91abb-69ba-44ce-af93-7223f9377f04] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:40.540950 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2bdbfefb-40ea-4453-8b43-30bf92832c0e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:40.541390 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2bdbfefb-40ea-4453-8b43-30bf92832c0e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:40.542140 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2bdbfefb-40ea-4453-8b43-30bf92832c0e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:40.542850 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-2bdbfefb-40ea-4453-8b43-30bf92832c0e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:40.555968 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-2bdbfefb-40ea-4453-8b43-30bf92832c0e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2bdbfefb-40ea-4453-8b43-30bf92832c0e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 HTTP/1.1 Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:30:40.557447 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:30:40.559142 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': '68b91abb-69ba-44ce-af93-7223f9377f04'} Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:30:40.560431 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. Jul 14 12:30:40.562339 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:40.563827 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-2bdbfefb-40ea-4453-8b43-30bf92832c0e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance 68b91abb-69ba-44ce-af93-7223f9377f04 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:30:40.563827 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-2bdbfefb-40ea-4453-8b43-30bf92832c0e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04" status: 404 len: 111 microversion: 2.1 time: 0.028213 Jul 14 12:30:40.563827 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 612/1207] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:40 2022] GET /compute/v2.1/servers/68b91abb-69ba-44ce-af93-7223f9377f04 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:30:41.843216 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e231f157-2c09-4aa9-8466-9a8a2be4db1e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:41.843718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-e231f157-2c09-4aa9-8466-9a8a2be4db1e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:41.850147 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e231f157-2c09-4aa9-8466-9a8a2be4db1e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:41.850598 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e231f157-2c09-4aa9-8466-9a8a2be4db1e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:41.851402 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e231f157-2c09-4aa9-8466-9a8a2be4db1e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:41.851842 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-e231f157-2c09-4aa9-8466-9a8a2be4db1e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:41.865162 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-e231f157-2c09-4aa9-8466-9a8a2be4db1e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e231f157-2c09-4aa9-8466-9a8a2be4db1e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: DELETE /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 HTTP/1.1 Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:30:41.866728 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:30:41.868347 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'b11f46c7-a881-4c33-a4b7-96933eebcf57'} Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:30:41.869254 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:30:41.870740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:30:41.872648 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-e231f157-2c09-4aa9-8466-9a8a2be4db1e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:30:41.872648 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-e231f157-2c09-4aa9-8466-9a8a2be4db1e tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "DELETE /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 404 len: 111 microversion: 2.1 time: 0.030203 Jul 14 12:30:41.872648 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 596/1208] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:30:41 2022] DELETE /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:30:41.877274 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6eace224-0c98-42fe-a7bb-ed889208e944 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:30:41.877883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6eace224-0c98-42fe-a7bb-ed889208e944 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] [instance: b11f46c7-a881-4c33-a4b7-96933eebcf57] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:30:41.884349 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6eace224-0c98-42fe-a7bb-ed889208e944 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:41.884800 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6eace224-0c98-42fe-a7bb-ed889208e944 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:41.885556 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6eace224-0c98-42fe-a7bb-ed889208e944 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:30:41.885991 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6eace224-0c98-42fe-a7bb-ed889208e944 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:30:41.900267 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-6eace224-0c98-42fe-a7bb-ed889208e944 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] HTTP exception thrown: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6eace224-0c98-42fe-a7bb-ed889208e944 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Request method failure captured: Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 HTTP/1.1 Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Asu4w7-b3DB4S-iGnEiH7CKSvI7JPcMzwK1iavMamX-8co3I3YWJoR39xNseX9EAUVlIaFboHV5gm-t54Al2yX8w9TK4EWmS2PGZc50fEysuTROclsQzNTe81NxqDsadIJewjBS5V7sC9UazSxn6HXxAHyc1rSUz8MzA1kMISw7xSo Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:30:41.901772 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_cc4efb6abcf3412897b7f1484988aa2b", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/cc4efb6abcf3412897b7f1484988aa2b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: cc4efb6abcf3412897b7f1484988aa2b Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-988300533 Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: 8d824401d1454a2bb19d7628e38b256a Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-AttachVolumeNegativeTest-988300533-project Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:30:41.903981 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'b11f46c7-a881-4c33-a4b7-96933eebcf57'} Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:30:41.904883 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. Jul 14 12:30:41.906367 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:30:41.907792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6eace224-0c98-42fe-a7bb-ed889208e944 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] Returning 404 to user: Instance b11f46c7-a881-4c33-a4b7-96933eebcf57 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:30:41.907792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6eace224-0c98-42fe-a7bb-ed889208e944 tempest-AttachVolumeNegativeTest-988300533 tempest-AttachVolumeNegativeTest-988300533-project] 10.222.0.27 "GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57" status: 404 len: 111 microversion: 2.1 time: 0.030462 Jul 14 12:30:41.907792 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 613/1209] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:30:41 2022] GET /compute/v2.1/servers/b11f46c7-a881-4c33-a4b7-96933eebcf57 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:31:39.339205 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-18e9fc42-222a-429f-b899-32b70b4cbe7d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:39.339901 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-18e9fc42-222a-429f-b899-32b70b4cbe7d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:39.342199 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:31:39.343167 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:31:39.345949 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG dbcounter [-] [118263] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118263) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:31:39.346582 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG dbcounter [-] [118262] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118262) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:31:39.350627 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-18e9fc42-222a-429f-b899-32b70b4cbe7d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:39.351209 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-18e9fc42-222a-429f-b899-32b70b4cbe7d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:39.352094 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-18e9fc42-222a-429f-b899-32b70b4cbe7d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:39.352744 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-18e9fc42-222a-429f-b899-32b70b4cbe7d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:39.382637 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-18e9fc42-222a-429f-b899-32b70b4cbe7d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Going to try to terminate instance {{(pid=118263) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:31:39.473569 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-3f8acb81-64db-467c-860b-1b8efa5e5353 req-c2549a4c-8202-4ba7-9f65-ce6f1f4f8a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f655b530-8145-4a12-bc24-b9836528039c", "tag": "ee3f4594-51d6-48db-a1d9-2d05b7a76d60"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:31:39.482194 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-3f8acb81-64db-467c-860b-1b8efa5e5353 req-c2549a4c-8202-4ba7-9f65-ce6f1f4f8a43 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:39.482638 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-3f8acb81-64db-467c-860b-1b8efa5e5353 req-c2549a4c-8202-4ba7-9f65-ce6f1f4f8a43 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:39.495471 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-3f8acb81-64db-467c-860b-1b8efa5e5353 req-c2549a4c-8202-4ba7-9f65-ce6f1f4f8a43 service nova] Creating event network-changed:ee3f4594-51d6-48db-a1d9-2d05b7a76d60 for instance f655b530-8145-4a12-bc24-b9836528039c on hv-cinder-84890 Jul 14 12:31:39.500876 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-3f8acb81-64db-467c-860b-1b8efa5e5353 req-c2549a4c-8202-4ba7-9f65-ce6f1f4f8a43 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163794 Jul 14 12:31:39.501824 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 614/1210] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:31:39.756939 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-18e9fc42-222a-429f-b899-32b70b4cbe7d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 204 len: 0 microversion: 2.1 time: 0.422198 Jul 14 12:31:39.757534 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 597/1211] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:31:39 2022] DELETE /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:31:39.768042 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-34e38253-f1bf-408e-816b-d312cd924569 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:39.768924 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-34e38253-f1bf-408e-816b-d312cd924569 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:39.776379 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34e38253-f1bf-408e-816b-d312cd924569 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:39.776831 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34e38253-f1bf-408e-816b-d312cd924569 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:39.777603 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34e38253-f1bf-408e-816b-d312cd924569 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:39.778042 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-34e38253-f1bf-408e-816b-d312cd924569 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:39.941941 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-34e38253-f1bf-408e-816b-d312cd924569 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:31:39.950597 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-34e38253-f1bf-408e-816b-d312cd924569 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1576 microversion: 2.1 time: 0.188402 Jul 14 12:31:39.951230 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 615/1212] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:39 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:31:40.974537 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-a4386323-84f5-4357-b8c9-4c845f1fc2fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:40.975270 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-a4386323-84f5-4357-b8c9-4c845f1fc2fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:40.982556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4386323-84f5-4357-b8c9-4c845f1fc2fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:40.982989 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4386323-84f5-4357-b8c9-4c845f1fc2fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:40.983894 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4386323-84f5-4357-b8c9-4c845f1fc2fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:40.984325 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-a4386323-84f5-4357-b8c9-4c845f1fc2fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:41.176606 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-a4386323-84f5-4357-b8c9-4c845f1fc2fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:31:41.184740 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-a4386323-84f5-4357-b8c9-4c845f1fc2fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1576 microversion: 2.1 time: 0.214851 Jul 14 12:31:41.185323 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 598/1213] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:40 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:31:42.203976 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-125721c9-8eab-461a-8bb6-b63ebd53604b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:42.204578 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-125721c9-8eab-461a-8bb6-b63ebd53604b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:42.212394 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-125721c9-8eab-461a-8bb6-b63ebd53604b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:42.212841 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-125721c9-8eab-461a-8bb6-b63ebd53604b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:42.213604 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-125721c9-8eab-461a-8bb6-b63ebd53604b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:42.214036 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-125721c9-8eab-461a-8bb6-b63ebd53604b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:42.279516 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-125721c9-8eab-461a-8bb6-b63ebd53604b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:31:42.290305 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-125721c9-8eab-461a-8bb6-b63ebd53604b tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1389 microversion: 2.1 time: 0.090544 Jul 14 12:31:42.291200 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 616/1214] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:42 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1389 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:31:42.323614 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:31:42.324109 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Thu Jul 14 12:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:31:42.348056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-8d2c73f9-7646-4cf2-bcd3-44a55634e85e req-ac96cfa6-9ccb-4b31-9d99-2392accb43b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f655b530-8145-4a12-bc24-b9836528039c", "name": "network-vif-deleted", "tag": "ee3f4594-51d6-48db-a1d9-2d05b7a76d60"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:31:42.357167 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-8d2c73f9-7646-4cf2-bcd3-44a55634e85e req-ac96cfa6-9ccb-4b31-9d99-2392accb43b5 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:42.357610 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-8d2c73f9-7646-4cf2-bcd3-44a55634e85e req-ac96cfa6-9ccb-4b31-9d99-2392accb43b5 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:42.368081 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-8d2c73f9-7646-4cf2-bcd3-44a55634e85e req-ac96cfa6-9ccb-4b31-9d99-2392accb43b5 service nova] Creating event network-vif-deleted:ee3f4594-51d6-48db-a1d9-2d05b7a76d60 for instance f655b530-8145-4a12-bc24-b9836528039c on hv-cinder-84890 Jul 14 12:31:42.373266 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-8d2c73f9-7646-4cf2-bcd3-44a55634e85e req-ac96cfa6-9ccb-4b31-9d99-2392accb43b5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028758 Jul 14 12:31:42.373873 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 599/1215] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:31:43.316108 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:43.316774 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:43.323069 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:43.323516 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:43.324287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:43.324723 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:43.356737 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:43.357187 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:43.357637 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lazy-loading 'fault' on Instance uuid f655b530-8145-4a12-bc24-b9836528039c {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:31:43.400341 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:31:43.408425 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-7f97de96-2ec1-48e3-9e19-a67c3b652627 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 200 len: 1228 microversion: 2.1 time: 0.105251 Jul 14 12:31:43.409000 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 617/1216] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:43 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 1228 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:31:44.428092 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4b2985a2-ea70-4be4-a9b7-4c1b2043ab4c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:44.428914 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-4b2985a2-ea70-4be4-a9b7-4c1b2043ab4c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: f655b530-8145-4a12-bc24-b9836528039c] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:44.435101 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4b2985a2-ea70-4be4-a9b7-4c1b2043ab4c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:44.435556 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4b2985a2-ea70-4be4-a9b7-4c1b2043ab4c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:44.436356 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4b2985a2-ea70-4be4-a9b7-4c1b2043ab4c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:44.436794 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-4b2985a2-ea70-4be4-a9b7-4c1b2043ab4c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:44.450328 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-4b2985a2-ea70-4be4-a9b7-4c1b2043ab4c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] HTTP exception thrown: Instance f655b530-8145-4a12-bc24-b9836528039c could not be found. Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4b2985a2-ea70-4be4-a9b7-4c1b2043ab4c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Request method failure captured: Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c HTTP/1.1 Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Ar_FgLC5zcoTyydSMFTVHf_w9AYcY1dbfJQjdCL7UmUqQgu5Ms3esbnNgdkYAm0LTmzfXr2gxhYbhSGDcA5aTkeVJVfs1NDTBrh35NeeCbLAXpKT2ti495fh5pXqbwfKzBL0L9ULtAvxL8sqG2bGxYyJhp44WPU7ZKuZ1Co4PQgJEo Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: c0d098ca721b409385a08b91d861b295 Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:31:44.451988 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0d098ca721b409385a08b91d861b295", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0d098ca721b409385a08b91d861b295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0d098ca721b409385a08b91d861b295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0d098ca721b409385a08b91d861b295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: c0d098ca721b409385a08b91d861b295 Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-TestVolumeBootPattern-1346970940-project Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: d0adaa092d944202b3279d10e0f94a91 Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-TestVolumeBootPattern-1346970940-project Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance f655b530-8145-4a12-bc24-b9836528039c could not be found. Jul 14 12:31:44.453806 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'f655b530-8145-4a12-bc24-b9836528039c'} Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f655b530-8145-4a12-bc24-b9836528039c could not be found. Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:31:44.454792 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f655b530-8145-4a12-bc24-b9836528039c could not be found. Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f655b530-8145-4a12-bc24-b9836528039c could not be found. Jul 14 12:31:44.456359 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:44.457697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-4b2985a2-ea70-4be4-a9b7-4c1b2043ab4c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Returning 404 to user: Instance f655b530-8145-4a12-bc24-b9836528039c could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:31:44.457697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-4b2985a2-ea70-4be4-a9b7-4c1b2043ab4c tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c" status: 404 len: 111 microversion: 2.1 time: 0.030239 Jul 14 12:31:44.457697 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 600/1217] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:44 2022] GET /compute/v2.1/servers/f655b530-8145-4a12-bc24-b9836528039c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:31:48.134803 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-6110a616-83c3-4070-866b-56abc5b709d2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:48.135325 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6110a616-83c3-4070-866b-56abc5b709d2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:48.138907 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [req-8b2b34ae-5f78-40b1-aea7-536f4dc440f0 req-a6d32235-b553-4b51-a790-6d90ae13a713 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7a5743-ed34-4140-b8e4-8cffa12d445e", "tag": "252f163a-d3e9-43b6-852d-55c257c784e1"}]} {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:31:48.142065 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6110a616-83c3-4070-866b-56abc5b709d2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:48.142511 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6110a616-83c3-4070-866b-56abc5b709d2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:48.143303 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6110a616-83c3-4070-866b-56abc5b709d2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:48.143739 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-6110a616-83c3-4070-866b-56abc5b709d2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:48.148374 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-8b2b34ae-5f78-40b1-aea7-536f4dc440f0 req-a6d32235-b553-4b51-a790-6d90ae13a713 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:48.149136 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [req-8b2b34ae-5f78-40b1-aea7-536f4dc440f0 req-a6d32235-b553-4b51-a790-6d90ae13a713 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:48.161108 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.compute.server_external_events [req-8b2b34ae-5f78-40b1-aea7-536f4dc440f0 req-a6d32235-b553-4b51-a790-6d90ae13a713 service nova] Creating event network-changed:252f163a-d3e9-43b6-852d-55c257c784e1 for instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e on hv-cinder-84890 Jul 14 12:31:48.166529 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [req-8b2b34ae-5f78-40b1-aea7-536f4dc440f0 req-a6d32235-b553-4b51-a790-6d90ae13a713 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031797 Jul 14 12:31:48.167678 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 601/1218] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 12:31:48.184609 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-6110a616-83c3-4070-866b-56abc5b709d2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Going to try to terminate instance {{(pid=118262) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 12:31:48.472329 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-6110a616-83c3-4070-866b-56abc5b709d2 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "DELETE /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 204 len: 0 microversion: 2.1 time: 0.342366 Jul 14 12:31:48.472931 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 618/1219] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:31:48 2022] DELETE /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 12:31:48.483255 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-368ca610-61b5-4679-a67d-87a82b427e16 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:48.484140 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-368ca610-61b5-4679-a67d-87a82b427e16 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:48.490910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-368ca610-61b5-4679-a67d-87a82b427e16 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:48.491351 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-368ca610-61b5-4679-a67d-87a82b427e16 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:48.492311 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-368ca610-61b5-4679-a67d-87a82b427e16 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:48.492762 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-368ca610-61b5-4679-a67d-87a82b427e16 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:48.654068 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-368ca610-61b5-4679-a67d-87a82b427e16 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:31:48.662912 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-368ca610-61b5-4679-a67d-87a82b427e16 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1577 microversion: 2.1 time: 0.184746 Jul 14 12:31:48.663718 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 602/1220] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:48 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1577 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:31:49.681787 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-ebfe3c18-5eb9-445f-8b0e-affc7e00bb3d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:49.682410 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-ebfe3c18-5eb9-445f-8b0e-affc7e00bb3d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:49.689830 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ebfe3c18-5eb9-445f-8b0e-affc7e00bb3d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:49.690287 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ebfe3c18-5eb9-445f-8b0e-affc7e00bb3d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:49.691086 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ebfe3c18-5eb9-445f-8b0e-affc7e00bb3d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:49.691522 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-ebfe3c18-5eb9-445f-8b0e-affc7e00bb3d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:49.891780 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-ebfe3c18-5eb9-445f-8b0e-affc7e00bb3d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:31:49.904537 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-ebfe3c18-5eb9-445f-8b0e-affc7e00bb3d tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1577 microversion: 2.1 time: 0.226783 Jul 14 12:31:49.905509 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 619/1221] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:49 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1577 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:31:50.921910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-baa14174-807d-4410-b152-8803d44191fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:50.922526 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-baa14174-807d-4410-b152-8803d44191fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:50.934657 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-baa14174-807d-4410-b152-8803d44191fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:50.935735 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-baa14174-807d-4410-b152-8803d44191fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:50.936856 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-baa14174-807d-4410-b152-8803d44191fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:50.937485 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-baa14174-807d-4410-b152-8803d44191fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:50.958744 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [req-8090e831-84f3-4de6-9da7-b38bd7a20788 req-c5d4d581-9859-4156-ad83-3851c6e542d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7a5743-ed34-4140-b8e4-8cffa12d445e", "name": "network-vif-deleted", "tag": "252f163a-d3e9-43b6-852d-55c257c784e1"}]} {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 12:31:50.966985 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-8090e831-84f3-4de6-9da7-b38bd7a20788 req-c5d4d581-9859-4156-ad83-3851c6e542d6 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:50.967511 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [req-8090e831-84f3-4de6-9da7-b38bd7a20788 req-c5d4d581-9859-4156-ad83-3851c6e542d6 service nova] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:50.979436 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.compute.server_external_events [req-8090e831-84f3-4de6-9da7-b38bd7a20788 req-c5d4d581-9859-4156-ad83-3851c6e542d6 service nova] Creating event network-vif-deleted:252f163a-d3e9-43b6-852d-55c257c784e1 for instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e on hv-cinder-84890 Jul 14 12:31:50.984346 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [req-8090e831-84f3-4de6-9da7-b38bd7a20788 req-c5d4d581-9859-4156-ad83-3851c6e542d6 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029456 Jul 14 12:31:50.984978 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 620/1222] 10.222.0.27 () {64 vars in 1317 bytes} [Thu Jul 14 12:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 12:31:51.020869 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.policy [None req-baa14174-807d-4410-b152-8803d44191fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:31:51.028473 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-baa14174-807d-4410-b152-8803d44191fb tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1390 microversion: 2.1 time: 0.110878 Jul 14 12:31:51.029037 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 603/1223] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:50 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1390 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:31:52.046425 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:52.047145 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:52.053878 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:52.054325 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:52.055122 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:52.060726 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:52.089530 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:52.089530 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:52.089530 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.objects.instance [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lazy-loading 'fault' on Instance uuid 3d7a5743-ed34-4140-b8e4-8cffa12d445e {{(pid=118262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 12:31:52.130742 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.policy [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0adaa092d944202b3279d10e0f94a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0d098ca721b409385a08b91d861b295', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 12:31:52.138547 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-a9a2cbd9-8ab2-4229-92fe-bf2010afc105 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 200 len: 1229 microversion: 2.1 time: 0.096663 Jul 14 12:31:52.139150 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 621/1224] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:52 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 12:31:52.379750 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:31:52.380302 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Thu Jul 14 12:31:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:31:53.160858 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-42aa03d1-00d0-4566-933c-1a72bbc877f7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:53.161609 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-42aa03d1-00d0-4566-933c-1a72bbc877f7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: 3d7a5743-ed34-4140-b8e4-8cffa12d445e] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:53.169379 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42aa03d1-00d0-4566-933c-1a72bbc877f7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:53.169857 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42aa03d1-00d0-4566-933c-1a72bbc877f7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:53.170700 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42aa03d1-00d0-4566-933c-1a72bbc877f7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:53.171197 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-42aa03d1-00d0-4566-933c-1a72bbc877f7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:53.185345 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-42aa03d1-00d0-4566-933c-1a72bbc877f7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] HTTP exception thrown: Instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e could not be found. Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-42aa03d1-00d0-4566-933c-1a72bbc877f7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Request method failure captured: Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e HTTP/1.1 Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Ar_FgLC5zcoTyydSMFTVHf_w9AYcY1dbfJQjdCL7UmUqQgu5Ms3esbnNgdkYAm0LTmzfXr2gxhYbhSGDcA5aTkeVJVfs1NDTBrh35NeeCbLAXpKT2ti495fh5pXqbwfKzBL0L9ULtAvxL8sqG2bGxYyJhp44WPU7ZKuZ1Co4PQgJEo Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: c0d098ca721b409385a08b91d861b295 Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:31:53.187024 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0d098ca721b409385a08b91d861b295", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0d098ca721b409385a08b91d861b295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0d098ca721b409385a08b91d861b295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0d098ca721b409385a08b91d861b295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: c0d098ca721b409385a08b91d861b295 Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-TestVolumeBootPattern-1346970940-project Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: d0adaa092d944202b3279d10e0f94a91 Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-TestVolumeBootPattern-1346970940-project Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e could not be found. Jul 14 12:31:53.188874 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': '3d7a5743-ed34-4140-b8e4-8cffa12d445e'} Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e could not be found. Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:31:53.190030 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e could not be found. Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e could not be found. Jul 14 12:31:53.191931 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.194368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-42aa03d1-00d0-4566-933c-1a72bbc877f7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Returning 404 to user: Instance 3d7a5743-ed34-4140-b8e4-8cffa12d445e could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:31:53.194368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-42aa03d1-00d0-4566-933c-1a72bbc877f7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e" status: 404 len: 111 microversion: 2.1 time: 0.032241 Jul 14 12:31:53.194368 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 604/1225] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:53 2022] GET /compute/v2.1/servers/3d7a5743-ed34-4140-b8e4-8cffa12d445e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:31:53.738281 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-adc2bb6b-6f64-4fc5-ba10-bbdd4d263248 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:53.738817 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.compute.api [None req-adc2bb6b-6f64-4fc5-ba10-bbdd4d263248 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118262) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:53.746173 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-adc2bb6b-6f64-4fc5-ba10-bbdd4d263248 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:53.746625 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-adc2bb6b-6f64-4fc5-ba10-bbdd4d263248 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:53.747452 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-adc2bb6b-6f64-4fc5-ba10-bbdd4d263248 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:53.747956 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG oslo_concurrency.lockutils [None req-adc2bb6b-6f64-4fc5-ba10-bbdd4d263248 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:53.765297 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.wsgi [None req-adc2bb6b-6f64-4fc5-ba10-bbdd4d263248 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] HTTP exception thrown: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-adc2bb6b-6f64-4fc5-ba10-bbdd4d263248 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Request method failure captured: Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: request: DELETE /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 HTTP/1.1 Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept: application/json Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Accept-Encoding: identity Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Connection: close Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Length: 0 Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Content-Type: application/json Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Host: 10.222.0.27 Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Openstack-System-Scope: None Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: User-Agent: python-urllib3/1.26.9 Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Auth-Token: gAAAAABi0Ar_FgLC5zcoTyydSMFTVHf_w9AYcY1dbfJQjdCL7UmUqQgu5Ms3esbnNgdkYAm0LTmzfXr2gxhYbhSGDcA5aTkeVJVfs1NDTBrh35NeeCbLAXpKT2ti495fh5pXqbwfKzBL0L9ULtAvxL8sqG2bGxYyJhp44WPU7ZKuZ1Co4PQgJEo Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Id: None Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Domain-Name: None Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Identity-Status: Confirmed Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Is-Admin-Project: True Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Id: default Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Domain-Name: Default Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Id: c0d098ca721b409385a08b91d861b295 Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Project-Name: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Role: reader,member Jul 14 12:31:53.766997 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Roles: reader,member Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0d098ca721b409385a08b91d861b295", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0d098ca721b409385a08b91d861b295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0d098ca721b409385a08b91d861b295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0d098ca721b409385a08b91d861b295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Id: c0d098ca721b409385a08b91d861b295 Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-Tenant-Name: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User: tempest-TestVolumeBootPattern-1346970940-project Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Id: default Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Domain-Name: Default Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Id: d0adaa092d944202b3279d10e0f94a91 Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: X-User-Name: tempest-TestVolumeBootPattern-1346970940-project Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: method: > Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: exception: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:31:53.768813 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: action_args: {'id': 'c9973bd5-77cb-4f58-8c30-5d0715218db6'} Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:31:53.769678 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:31:53.771178 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.773048 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-adc2bb6b-6f64-4fc5-ba10-bbdd4d263248 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Returning 404 to user: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. {{(pid=118262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:31:53.773048 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-adc2bb6b-6f64-4fc5-ba10-bbdd4d263248 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 404 len: 111 microversion: 2.1 time: 0.034043 Jul 14 12:31:53.773048 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 622/1226] 10.222.0.27 () {58 vars in 1238 bytes} [Thu Jul 14 12:31:53 2022] DELETE /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:31:53.777591 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cb84251a-d62b-417f-86b6-a7975c01a2a9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '>' {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:53.778214 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.compute.api [None req-cb84251a-d62b-417f-86b6-a7975c01a2a9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] [instance: c9973bd5-77cb-4f58-8c30-5d0715218db6] Fetching instance by UUID {{(pid=118263) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 12:31:53.784259 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cb84251a-d62b-417f-86b6-a7975c01a2a9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:53.784711 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cb84251a-d62b-417f-86b6-a7975c01a2a9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:53.785471 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cb84251a-d62b-417f-86b6-a7975c01a2a9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 12:31:53.785910 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG oslo_concurrency.lockutils [None req-cb84251a-d62b-417f-86b6-a7975c01a2a9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Lock "870b9fcc-f09e-4ee9-b505-0d63e5cd6a7e" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 12:31:53.799585 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.wsgi [None req-cb84251a-d62b-417f-86b6-a7975c01a2a9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] HTTP exception thrown: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cb84251a-d62b-417f-86b6-a7975c01a2a9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Request method failure captured: Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: request: GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 HTTP/1.1 Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept: application/json Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Accept-Encoding: identity Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Connection: close Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Length: 0 Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Content-Type: application/json Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Host: 10.222.0.27 Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Openstack-System-Scope: None Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: User-Agent: python-urllib3/1.26.9 Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Auth-Token: gAAAAABi0Ar_FgLC5zcoTyydSMFTVHf_w9AYcY1dbfJQjdCL7UmUqQgu5Ms3esbnNgdkYAm0LTmzfXr2gxhYbhSGDcA5aTkeVJVfs1NDTBrh35NeeCbLAXpKT2ti495fh5pXqbwfKzBL0L9ULtAvxL8sqG2bGxYyJhp44WPU7ZKuZ1Co4PQgJEo Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Id: None Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Domain-Name: None Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Identity-Status: Confirmed Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Is-Admin-Project: True Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Id: default Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Domain-Name: Default Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Id: c0d098ca721b409385a08b91d861b295 Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Project-Name: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Role: reader,member Jul 14 12:31:53.801086 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Roles: reader,member Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:8080/v1/AUTH_c0d098ca721b409385a08b91d861b295", "adminURL": "http://10.222.0.27:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/c0d098ca721b409385a08b91d861b295"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0d098ca721b409385a08b91d861b295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/c0d098ca721b409385a08b91d861b295"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}] Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Id: c0d098ca721b409385a08b91d861b295 Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-Tenant-Name: tempest-TestVolumeBootPattern-1346970940 Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User: tempest-TestVolumeBootPattern-1346970940-project Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Id: default Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Domain-Name: Default Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Id: d0adaa092d944202b3279d10e0f94a91 Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: X-User-Name: tempest-TestVolumeBootPattern-1346970940-project Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: method: > Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: exception: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:31:53.802777 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: action_args: {'id': 'c9973bd5-77cb-4f58-8c30-5d0715218db6'} Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: {{(pid=118263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 12:31:53.803732 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. Jul 14 12:31:53.805327 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: ERROR nova.api.openstack.wsgi Jul 14 12:31:53.806738 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: DEBUG nova.api.openstack.wsgi [None req-cb84251a-d62b-417f-86b6-a7975c01a2a9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Returning 404 to user: Instance c9973bd5-77cb-4f58-8c30-5d0715218db6 could not be found. {{(pid=118263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 12:31:53.806738 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO nova.api.openstack.requestlog [None req-cb84251a-d62b-417f-86b6-a7975c01a2a9 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6" status: 404 len: 111 microversion: 2.1 time: 0.028642 Jul 14 12:31:53.806738 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: [pid: 118263|app: 0|req: 605/1227] 10.222.0.27 () {58 vars in 1235 bytes} [Thu Jul 14 12:31:53 2022] GET /compute/v2.1/servers/c9973bd5-77cb-4f58-8c30-5d0715218db6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 12:31:55.363513 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: DEBUG nova.api.openstack.wsgi [None req-4c95225d-4fcd-4303-bca7-c29bc186c5d7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] Calling method '.version_select at 0x7f0e2671a940>' {{(pid=118262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 12:31:55.445754 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO nova.api.openstack.requestlog [None req-4c95225d-4fcd-4303-bca7-c29bc186c5d7 tempest-TestVolumeBootPattern-1346970940 tempest-TestVolumeBootPattern-1346970940-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-153859730" status: 202 len: 0 microversion: 2.1 time: 0.086013 Jul 14 12:31:55.449322 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: [pid: 118262|app: 0|req: 623/1228] 10.222.0.27 () {58 vars in 1259 bytes} [Thu Jul 14 12:31:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-153859730 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 12:33:55.051056 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:33:55.051680 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Thu Jul 14 12:33:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:35:02.333276 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:35:02.334075 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Thu Jul 14 12:35:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:35:09.622999 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:35:09.623616 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Thu Jul 14 12:35:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:35:12.388487 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:35:12.388957 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Thu Jul 14 12:35:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:35:13.631630 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:35:13.632149 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Thu Jul 14 12:35:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:37:05.623811 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:37:05.624575 dv-cinder-848900-3-iscsi devstack@n-api.service[118262]: Thu Jul 14 12:37:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 12:37:15.059684 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 12:37:15.060241 dv-cinder-848900-3-iscsi devstack@n-api.service[118263]: Thu Jul 14 12:37:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!